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FOREWORD 


This  report  presents  results  of  a survey  of  the  behavioral  science 
literature  dealing  with  the  subject  of  long-term  retention  of  flight  skills. 
The  effort  was  performed  for  the  Office  of  the  Assistant  Chief  of  Staff, 
Studies  and  Analysis,  Hq.,  United  States  Air  Force,  in  support  of  their 
studies  of  pilot  proficiency  and  management  of  the  rated  force  (SABER 
WINGS  II) . The  literature  survey  results  are  presented  here  in  the  form 
of  an  annotated  bibliography.  Interpretive  commentary  relating  that 
literature  to  USAF  concerns  is  presented  in  a companion  report,  HumRRO 
FR-ED(F)-76-35. 

Technical  monitorship  for  this  effort  was  provided  by  Dr.  Robert  N. 
Schwartz  and  Dr.  Thomas  C.  Donohue  of  Che  Analysis  and  Evaluation  Group, 
ACS/Studles  and  Analysis,  Hq.,  USAF.  Their  assistance  is  gratefully 
acknowledged,  as  is  that  of  numerous  research  colleagues  in  the  US  and  in 
Europe.  In  addition,  civilian  and  military  flight  training  and  management 
agencies  have  provided  Inputs,  and  a wide  variety  of  library  resources  have 
provided  assistance.  Particular  thanks  are  due  the  USAF  Air  University 
Library,  Maxwell  AFB,  AL  and  many  of  its  staff  who  provided  most  valuable 
assistance.  Dr.  Paul  W.  Caro,  HumRRO,  has  provided  technical  input  through- 
out the  effort. 

This  project  was  performed  under  AFOSR  Contract  No.  F44620-76-C-0106. 
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I.  INTRODUCTION 

BACKGROUND 

Aviation  training  reproaants  on«  of  tha  coatileat  manpower  Inveatnwnts 
that  tho  military  servlcoa  make.  While  determination  of  the  coat  of  pro- 
ducing a combat-ready  pilot  for  the  United  Statea  Air  Force  ia  beyond  the 
acope  of  thia  report,  eatimatea  in  the  range  of  $2CO,000^$300,000  are 
frequently  given.  In  any  event,  the  Inveatment  repreaented  in  the  initial 
training  of  the  more  than  25,000  pllota  preaently  in  the  Air  Force  is 
aizeable  indeed.  Thua,  it  ia  logical  that  the  Air  Force  ahould  be  con- 
cerned about  the  beat  meana  to  employ  qnd  maintain  thia  reaource.  It  ia 
thla  concern,  baalcally,  that  Ilea  behind  the  study  currently  being  con- 
ducted by  the  Air  Force  under  the  title  of  SABER  WINGS  II. 

The  career  of  the  USAF  pilot  is  one  of  constant  training  to  maintain 
the  high  levels  of  skill  required  for  operational  mlaslona.  Such  recurrent 
training  is  also  coatly  and  has  cone  under  increasing  scrutiny  by  USAF, 

DpD,  and  the  Congress.  While  it  is  clearly  racognlsed  by  all  concerned 
that  the  USAF  must  maintain  a high  state  of  combat  readiness  for  a wide 
range  of  combat  contingencies,  the  decreasing  availability  of  fiscal  and 
other  resources  to  support  the  training  required  for  that  state  ox  readl- 
uass  has  resulted  in  the  direction  of  even  greater  attention  to  efforts  to 
manage  the  pilot  resource  with  maximum  cost  effectiveness. 

The  USAF  pilot,  in  the  normal  course  of  his  service  career,  will 
rotate  through  a series  of  job  assignments  after  completing  his  under- 
graduate pilot  training  (UPT)  and  qualification  in  a combat  aircraft 
through  advanced  training  at  one  of  the  Combat  Crew  Training  Schools  (CCTS). 
After  CCTS,  he  would  pormally  be  assigned  to  flying  duty  (cockpit  assignment) 


In  an  operational  unit.  After  one  or  more  such  cockpit  assignments,  he 
will  likely  receive  a non~flying  assignment  involving  staff  duty,  advanced 
military  or  academic  education,  or  other  non-cockpit  duties.  It  is  the 
concern  for  the  pilot's  proficiency  during  these  non-flying  assignments 
that  has  led  the  Air  Force  to  its  SABER  WINGS  II  study,  to  which  this 
report  is  related. 

It  has  long  been  recognized  that  pilot  skills  will  deteriorate  if  not 
exercised  regularly  (as  will  most,  if  not  all,  human  skills),  and,  conse- 
quently, the  military  services  have  required  that  most  pilots  engage  in 
some  amount  of  "proficiency  flying"  or  "combat  readiness  training"  during 
these  non-flying  assignments  in  order  to  retain  their  flying  skills  at  an 
acceptable  level.  The  amount  of  such  proficiency  flying  has  varied  from 
time  to  time  and  service  to  service,  but  the  required  "annual  mlnlmums" 
have  generally  ranged  from  80  to  120  hours.  However,  some  such  flying  has 
been  felt  necessary  in  order  to  provide  backup  pilot  manpower  (i.e.,  the 
rated  supplement)  in  a state  of  skill  readiness  sufficient  for  USAF  to  meet 
its  immediate  surge  and  longer  range  requirements  in  the  event  of  hostil- 
ities. In  addition,  it  has  been  felt  that  such  flying  was  required  to 
minimize  retraining  costs  for  personnel  moving  back  into  cockpit  Jobs  from 

I 

non-flying  assignments. 

Those  who  are  familiar  with  the  topic  of  proficiency  flying  are  aware 
that  it  is  a complex,  even  emotional,  subject.  We  do  not  Intend  to  explore 
the  subject  here,  beyond  noting  that  proficiency  flying  programs  have  been 
the  subject  of  much  discussion  for  many  years,  and  many  questions  have  been 
raised,  such  as: 

How  much  time  is  required  to  maintain  proficiency? 

How  much  proficiency  is  required? 

Are  current  programs  effective? 
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What  kind  of  aircraft  should  be  used? 

How  can  costs  be  miniralzed? 

Is  proficiency  flying  even  required? 

Should  pilots  receive  flight  pay  if  they  do  not  engage  in 
proficiency  flying  during  non-flying  asslgnaients? 

Will  the  pilot  become  "non-viable"  in  terms  of  his  acceptability 
to  the  combat  commander  if  he  does  not  engage  In  proficiency  programs? 
Such  questions  have  been  asked  over  and  over,  and  many  forceful  argu- 
ments have  been  advanced  for  and  against  proficiency  flying.  However,  in 
recent  years,  these  questions  have  taken  on  a new  urgency  because  of  con** 
tinned  cost  escalation  in  the  face  of  an  increasingly  strained  defense 
budget  situation.  A most  critical  added  dimension  has  been  the  Arab  oil 
embargo  of  1973  and  the  prospect  that  fuel  resources  to  support  flying 
programs  in  the  manner  of  the  past  may  simply  not  be  available,  regardless 
of  fiscal  resources.  Thus,  the  alternative  that  some  or  all  pilot  personnel 
who  are  in  non-flying  assignments  not  be  allowed  to  engage  in  any  flying 
activities  has  become  a very  real  one,  one  that  the  USAF  must  examine. 

As  has  been  noted,  the  topic  of  proficiency  flying  (or  its  possible 
elimination)  is  both  important  and  emotional.  Hot  only  are  there  problems 
resulting  from  the  possible  conflicts  among  defense  readiness  requirements 
and  increasing  competition  for  available  resources  (not  to  mention  the 
spector  of  possible  loss  of  flight  pay),  there  is  the  fact  that  pilots  like 
to  fly.  The  sheer  enjoyment  of  flying  is  one  of  the  main  factors  that  has 
attracted  most  of  them  to  the  Air  Force  or  the  ocher  flying  services.  Thus, 
the  possible  effectr  of  various  proficiency  flying  program  alternatives, 
including  that  of  no  flying,  on  pilot  morale,  motivation,  and  career  re- 
tainabllity  are  also  a part  of  this  picture  of  concern.  As  can  be  seen,  the 
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problems  of  managing  the  pilot  resource,  the  Investment  it  represents, 
and  the  operational  capabilities  represented  are  exceedingly  complex.  In 
SABER  WINGS  II  a systematic  examination  of  these  problems  Is  being  conducted, 
on  the  basis  of  which  the  USAF  seeks  to  develop  informed  and  effective 
policies  for  the  future. 

BEHAVIORAL  SCIENCE  RESEARCH 

As  one  examines  the  various  aspects  of  flying  proficiency  maintenance, 
it  Is  apparent  that  one  of  its  most  fundamental  dimensions  is  a behavioral 
one  dealing  with  the  conditions  necessary  to  acquire,  maintain,  or  reacquire 
complex  skills.  In  addition,  if  one  examines  the  history  of  proficiency 
flying  programs,  he  sees  that  such  programs  (or  opposition  to  them)  have 
been  based  much  more  on  rhetoric  chan  on  research.  There  are,  In  fact,  few 
comprehensive  research  studies  that  have  dealt  with  Che  subject  of  how  best 
to  maintain  flying  skills  or  with  the  rate  or  manner  in  which  they  degrade 
over  time  during  periods  of  non-flying.  Since  an  understanding  of  the 
learning  and  retention  processes  is  so  fundamental  to  USAF  management  of 
Its  rated  supplement  pilots,  personnel  in  the  Office  of  the  Assistant  Chief 
of  Staff,  Studies  and  Analysis,  Hq.,  USAF,  sought  to  have  the  literature 
dealing  with  long-term  retention  of  piloting  skills,  particularly  the  be- 
havioral science  literature,  systematically  surveyed.  The  Implications  of 
that  literature  would  be>4ntegrated  with  other  Inputs  into  their  broad  study 
of  USAF  problems  In  this  general  area.  The  work  reported  here,  along  with 
that  In  a companion  report  provides  a basis  for  Input  into  USAF  de- 
liberations. 

Briefly  stated,  the  objectives  of  the  present  effort  were  to  survey 

— Prophet,  W.W.  Long-Term  Retention  of  Flying  Skills;  A Review  of  the 
Literature.  HumRRO  FR-ED(P)-76-35,  Human  Resources  Research  Organization, 
Alexandria,  VA,  October  1976. 
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the  literature  on  long-term  retention  of  flying  skills,  to  survey  selected 
knowledgeable  researchers  and  agencies  who  might  be  working  in  the  content 
area,  to  summarize  the  literature  in  the  form  of  an  annotated  bibliography, 
and  to  provide  an  Interpretive  report  presenting  major  implications  of  that 
literature  for  future  Air  Force  actions.  The  present  report  is  the  anno- 
tated bibliography. 

METHOD 

In  carrying  out  the  literature  survey,  conventional  methods  were 
followed.  The  principal  document  sources  utilized  were  the  various  HumRRO 
office  libraries,  particularly  that  of  the  HumRRO  Pensacola  Office  with 
its  more  than  25,000  items,  mostly  in  the  field  of  aviation  psychology. 
Ocher  document  sources  included  the  USAF  Air  University  Library  at  Maxwell 
AFB,  AL,  the  Library  of  the  Aviation  Research  Laboratory  at  the  University 
of  Illinois,  the  University  of  West  Florida  Library,  the  Defense  Documen- 
tation Center  (DDC) , and  the  National  Technical  Information  Service  (NTIS). 
Professional  colleagues,  both  military  and  civilian,  in  this  country  and 
in  Europe,  provided  documents  and  suggestions  for  other  sources,  as  well 
as  general  observations  about  the  retention  problem.  The  FAA,  NASA,  and 
the  airline  industry  also  provided  inputs. 

In  conducting  the  literature  search,  several  basic  source  documents 


were  especially  useful.  A wide-range  computer  bibliographic  search  dealing 
with  flying  skill  acquisition,  forgetting,  and  retention  was  requested  from 
DDC.  The  print-out  of  titles  and  abstracts  totaled  about  1,400  items.  Of 
course,  the  bulk  of  these  were  not  pertinent,  but  many  were.  DDC  also 
provided  a print-out  of  Work  Unit  Summaries  of  current  research  dealing 
with  flying  skills.  In  addition,  searches  were  made  of  Psychological 
Abstracts  and  Dissertation  Abstracts.  Other  particularly  helpful  starting 


points  were  previous  reviews  of  the  literature  pertinent  to  flying  skill 

retention  contained  in  reports  by  Smode,  Hall,  and  Meyer  (1966),  Wright 

1/ 

(1969),  Gardlin  and  Sltterley  (1972),  and  Smith  and  Matheny  (1976) As 
titles  were  developed  from  these  and  other  sources,  abstracts  of  the  docu- 
ments, or  the  documents  themselves,  were  examined  to  make  a preliminary 
determination  of  their  pertinence  to  the  present  effort.  If  deemed  perti- 
nent, an  attempt  was  made  to  secure  the  Item  from  HumRRO  or  other  library 
or  document  sources  for  first-hand  examination  and  review.  While  a few 
documents  that  surfaced  by  this  procedure  could  not  be  secured  (e.g.,  an 
organization's  Internal  research  memorandum  or  note,  no  longer  retrievable), 
the  great  preponderance  of  Items  sought  was  secured.  Eventually,  a file 
of  more  than  200  documents  was  assembled  for  review.  Some  of  these  are  not 
Included  here  because,  upon  Inspection,  they  proved  to  be  Irrelevant  to 
this  report. 

While  no  claim  Is  made  here  that  all  the  significant  literature 
directly  pertinent  to  the  subject  of  long-term  retention  of  flying  skills 
was  discovered,  we  feel  that  most  of  the  significant  literature  is  repre- 
sented. Undoubtedly,  more  time  and  greater  resources  for  the  search  might 
have  yielded  additional  items  of  significance,  but  major  change  would  seen 
unlikely. 

A word  is  In  order  concerning  what  was  and  was  not  Included  In  this 
search.  The  search  was  generally  directed  toward  studies  dealing  with 
flying  skills  per  se,  or  studies  dealing  with  perceptual-motor  skills 
reasonably  pertinent  to  flying  or  complex  performance.  No  attempt  was  made 
to  cover  systematically  the  general  learning/forgetting  academic  literature 

— The  reader  is  referred  to  the  bibliographic  listing  in  Section  H of 
this  report  for  full  citations  of  these  documents. 


on  the  grounds  that  (1)  most  of  It  is  of  peripheral  concern^  at  best^  to 
current  USAF  problems  (It  le  overwhelmingly  concerned  with  verbal  learning), 
and  (2)  time  and  resources  did  not  permit.  However,  certain  items  from 
this  area  were  Included. 

As  the  reader  examines  the  literature  covered  in  this  review,  he 
cannot  help  but  be  impressed  by  Its  relative  paucity,  considering  the  im- 
portance of  the  topic.  At  least  three  reasons  can  be  cited  for  this  lack. 
First,  the  conduct  of  flight  training  research  is  quite  costly,  particularly 
when  high  skill  levels  for  complex  military  aircraft  are  involved.  Second, 
achieving  appropriate  and  rigorous  experimental  control  of  the  activities 
of  test  subjects  during  a no-practlce  retention  interval  is  virtually  im- 
possible for  the  subject  populations  and  time  intervals  (l.e.,  1-3  years) 
of  concern.  And,  third  is  the  fact  that  the  requirement  for  such  research 
apparently  has  not  been  brought  to  the  attention  of  defense  budget  managers 
and  decision  makers  In  a manner  sufficiently  forceful  that  the  research 
would  receive  the  long-term  support  necessary  for  Its  effective  conduct. 

The  recent  fiscal  and  fuel  crises  have  changed  this  situation,  and  the  need 
for  such  information  is  more  clearly  recognized. 

ORGANIZATION  OF  THE  REPORT 

There  are  seven  sections  of  this  report,  including  the  present  intro- 
ductory section.  Section  II  provides  basic  bibliographic  reference  cita- 
tions, arranged  alphabetically  by  author  or  originating  agency,  for  the 
items  for  whxch  abstracts  or  annotations,  in  varying  degrees  of  detail, 
are  provided  in  Sections  III-VI.  Finally,  Section  VII  contains  a biblio- 
graphic listing  of  certain  items  that  were  reviewed  in  some  detail,  but 
are  not  abstracted  here  because  they  are  of  no  strong  pertinence  to  the 
subject  of  concern. 
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Section  II  contains  a page  indexing  Indicating  where  In  Sections 
III-VI  the  annotation  for  each  of  the  Items  can  be  found.  In  some  In- 
stances, several  citations  may  be  covered  by  a single  abstract  or  anno- 
tation. This  Is  done  when  the  same  research  study  (or  portions  thereof) 

' nay  have  been  published  in  several  formats  (e.g.,  as  a technical  report 
and  In  a professional  Journal) , or  when  a aeries  of  closely  related  re- 
search studies  may  have  resulted  In  several  publications.  Three  formats, 
generally  corresponding  to  level  of  detail,  are  used  in  the  annotations, 
as  follows: 

Level  A - A four  paragraph  format  Is  used.  The  first  paragraph 
provides  a brief  description  of  the  study  or  effort. 

The  second  {paragraph  sumsnarlzes  major  results,  while 
the  third  summarizes  major  conclusions.  The  fourth 
paragraph  Is  a comment  by  the  present  author,  some- 
times evaluative,  relating  the  effort  to  the  retention 
problem  of  concern  here. 

Level  B - A two  paragraph  format  is  used,  with  the  first  para- 
graph being  a summary  of  the  effort  in  terms  of  problem, 
method,  and  results.  The  second  Is  a comment  similar 
In  nature  to  that  described  for  Level  A. 

Level  C - A single  paragraph  is  used,  often  only  a few  sentences, 
to  comment  on  selected  aspects  of  the  effort  reported. 

In  general,  the  A format  is  used  only  for  efforts  felt  to  be  of  rela- 
tively major  importance  to  the  present  review.  These  Items  also  are  In 
the  nature  of  experiments  or  studies  in  which  there  are  data  gathered  deal- 
ing with  effects  of  experimental  variables  or  conditions.  The  B format  Is 
used  for  Items  of  lesser  Import  In  the  present  context  or.  In  some  cases. 
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for  item*  that  night  be  of  major  Inportanee  In  the  present  context,  but 
which  were  not  of  the  nature  of  an  experiment,  for  exanq>le,  a review  of 
literature.  The  Items  presented  in  the  C format  are  items  Judged  to  be 
of  relatively  minor  importance  In  the  present  context. 

Sections  III-VI  contain  groupings  of  the  annotated  references,  as 
follows > 

Section  III  contains  abstracts  of  those  items  that  are  direct 
studies  of  the  retention  of  flying  skills  or  flight  related  skills 
such  as  a radar  intercept  task  skill.  Some  deal  with  whole-task 
studies,  while  others  deal  with  part-tasks,  and  both  aircraft  and 
simulator  studies  are  Included. 

Section  IV  contains  retention  studies  dealing  with  more  general 
motor  skills  or  procedural  tasks.  These  studies  are  of  Interest,  but 
require  somewhat  greater  extrapolation  for  application  to  the  flight 
skill  retention  area  than  do  the  items  in  Section  III. 

Section  V includes  a variety  of  non-retention  aviation  studies 
that  deal  with  the  acquisition  of  flying  skills  (as  opposed  to  their 
retention),  aircraft  accident  data,  the  nature  of  the  pilot  task, 
transfer  of  training,  and  similar  areas  of  Interest.  These  are  not 
retention  studies,  though  they  are  of  relevance  to  the  subject. 

Section  VI  contains  references  to  other  literature  reviews 
or  textbooks. 

Only  one  item  (the  Smith  and  Matheny  review)  appears  in  more  than 
one  section.  It  is  in  both  Section  III,  because  It  contains  data  not 
elsewhere  available,  and  in  Section  VI,  because  it  is  basically  a litera- 
ture review. 
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In  listing  ths  Items  In  Sections  IIIoVl,  the  Level  A end  Level  B 
Items  ere  Intermixed,  appearing  generally  In  the  alphabetical  order  In 
which  they  are  listed  In  Section  II,  while  the  Level  C Items  appear  only 
after  the  A and  B listings.  In  order  to  ease  the  work  of  manuscript  typing, 
each  A and  B Item  begins  on  a new  page  even  though  this  adds  a little  bulk 
to  the  document. 
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II.  BIBLIOGRAPHY  INDEX 


This  section  gives  the  basic  bibliographic  citation  for  all  items 
for  which  abstracts  or  annotated  information  is  presented  in  Sections 
IIl-VI  of  this  report.  Items  are  arranged  alphabetically  by  author  (or 
agency  if  no  individual  author  is  given)  and  are  numbered  serially.  Also 
shown  for  each  item  is  the  format  in  which  it  is  abstracted,  l.e.,  Levels 
A,  B,  or  C.  Level  A contains  four  paragraphs  and,  generally,  more  detail 
than  is  given  in  the  other  two  formats.  Level  B contains  two  paragraphs 
and  is  more  detailed  than  Level  C,  which  contains  only  a single  paragraph. 

For  each  item  listed,  a page  location  is  given  to  aid  in  locating  the 
abstract  in  Sections  III,  IV,  V,  or  VI.  For  example,  an  item  that  shows 
Level  A,  page  III-12,  is  a four  paragraph  format  abstract  that  can  be  found 
on  page  12  of  Section  III.  Similarly,  an  item  listed  as  Level  C,  page 
V-6,  is  a single  paragraph  abstract  located  on  page  6 of  Section  V.  As 
has  already  been  noted,  each  reference  item  appears  in  only  one  section 
with  the  exception  of  the  Smith  and  Matheny  report  that  appears  both  in 
Section  III  and  Section  VI. 
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III.  FLIGHT  SKILL  RETENTION  STUDIES 

This  section  contains  those  studies  that  deal  directly  with  the 
subject  of  retention  of  flying  skills.  Some  are  concerne4  with  global 
evaluations  of  whole-tasks  or  overall  flight  skills t while  others  are 
concerned  with  part-tasks  or  more  restricted  segments  of  flight  skills. 
Both  aircraft  and  simulator  studies  are  Included.  In  the  case  of  some 
simulator  studies,  the  flight  skill  task  studied  may  be  a synthetic  task 
that  deals  with  a skill  that  is  sufficiently  fllght-llke  that  the  study 
is  Included  in  this  section  rather  than  In  the  section  dealing  with  more 
general,  non-flight  motor  skills.  Xn  some  Instances,  a study  might  well 
have  been  Included  In  Section  IV  rather  than  Section  III,  but  in  any  event, 
both  Section  HI  and  Section  IV  are  of  primary  Interest  in  the  present 
context  because  they  deal  with  retention  studies. 
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2.  Adams,  J.A. , and  Hufford,  L.E.  "Contributions  of  a Part-Task  Trainer 

to  ths  Laarnlifig  and  Relearning  of  a Time-Shared  Flight  Maneuver."  Human 
Factors.  1962,  4,  159-170. 

3.  Adams,  J.A. , Hufford,  L.E.,  and  Dunlop,  J.M.  Part-  Versus  Whole-Task 
Learning  of  a Flight  Maneuver.  NAVTRADEVCEN  297-1,  U.  S.  Naval  Traii^ing 
Device  Center,  Port  Washington,  NY,  1960. 

49.  Hufford,  L.E.,  and  Adams,  J.A.  The  Contribution  of  Part-Task  Training 

to  the  Relearning  of  a Flight  Maneuver.  NAVTRADEVCEN  297-2,  U.  S.  Naval 
Training  Device  Center,  Port  Washington,  NY,  1961. 


1.  Description 

The  purpose  of  these  two  companion  studies  was  to  investigate  the 
contribution  of  part-task  training  to  the  learning  and  relearning  (after 
a period  of  10  months)  of  a fairly  complex  flight  maneuver  (bomb-toss) 
performed  In  an  operational  flight  trainer  for  the  SNJ  aircraft.  The 
study  was  concerned  with  the  use  of  part-task  trainers  In  the  teaching 
of  complex  time-shared  tasks.  Experimental  group  Ss  (N»16)  learned  the 
procedural  and  flight-control  components  separately  as  part-tasks,  while 
Control  Ss  (N<«14)  learned  on  a whole-task  basis  in  the  SNJOFT.  Ten  months 
later,  10  Ss  from  each  group  participated  in  a retention-relearning  study. 

2.  Results 


a.  There  was  little  difference  In  the  relative  effectiveness  of  whole- 
and  part-task  training  in  the  original  learning,  except  for  a decrement 

In  performance  of  procedures  by  the  experimental  group  on  their  first  whole- 
task  trial. 

b.  Forgetting  of  procedures  was  virtually  complete  over  the  10-month 
interval,  dropping  from  95%  correct  on  the  last  original  learning  trial 
to  only  5%  correct  on  the  first  retention  trial. 

c.  Retraining  of  procedural  skills  on  a part-task  basis  did  not  restore 
procedures  performance  to  original  levels  when  procedures  were  required  to 
be  performed  In  the  whole-task  (time  sharing)  situation. 

d.  Control  of  bank  angle  showed  a statistically  significant  loss  In 
proficiency  over  the  10-month  Interval;  however,  the  mean  increase  of  less 
than  two  degrees  was  not  considered  to  have  practical  operational  signi- 
ficance for  flight  training. 

e.  Mean  vertical  speed  error  Increased  from  about  150  ft/mln  on  the 
last  original  learning  trial  to  about  500  ft/mln  on  the  first  retention 
trial.  For  the  experimental  group  with  procedural  retraining  before  the 
whole-task  trials,  original  proficiency  was  regained  by  the  second  three- 
minute  trial.  For  the  group  not  receiving  this  training,  performance  was 
not  regained  until  the  fifth  trial  In  retraining.  This  substantial  loss 
in  Vertical  speed  control  differs  from  other  studies  that  have  shown  no 
substantial  loss  In  control  of  other  continuous  parameters.  The  substantial 
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lag  In  this  parameter,  or  highly  procedural  components  in  It  in  the  bomb- 
toss  maneuver  used,  were  hypothesized  as  the  basts  for  this  loss. 

3.  Conclusions 


a.  Substantial  losses  In  procedural  skills  occurred  over  the  10--month 
Interval.  Bank  control  remained  gcod  over  the  Interval,  but  vertical  speed 
error  Increased  markedly. 

b.  Cockpit  procedures  training,  although  reducing  retraining  time, 
could  not  completely  restore  lost  proficiency  in  procedures.  Some  addi- 
tional whole-task  practice  was  required  to  fully  restore  whole-task  per- 
formance. 

c.  Time-sharing  is  a variable  in  recall  and  relearning,  just  as  it 
is  in  original  learning. 

d.  A simulator  that  allows  whole-task  practice  is  the  best  device  for 
the  retraining  of  task  skills  that  Involve  time  sharing,  but  quite  simple 
devices  can  still  be  used  to  considerable  advantage. 

4.  Comments 


These  were  well-designed  studies  with  data  gathered  under  well- 
controlled  conditions.  The  results  are  generally  consonant  with  those 
of  a number  of  other  investigations.  The  studies  suffer  in  terms  of 
the  somewhat  restricted  nature  of  the  single  maneuver  Involved  and  in 
terms  of  the  rather  limited  sampling  of  flight  control  parameters  for 
study.  Nevertheless,  while  they  clearly  show  the  considerable  effects 
of  time  on  the  retention  of  procedural  skills,  they  also  show  that  those 
skills  can  be  easily  relearned. 


/ 

/ 


6.  American  Airlines,  Inc.  Requallflcatlon  Take-off  and  Landing  Study. 

American  Airlines  Flight  Training  Academy,  Port  Worth,  TX,  February  1976. 


1.  Description 

The  objective  of  this  study  was  to  determine  whether  a modern  digital 
flight  simulator,  with  rigid  model  color  visual  system,  could  be  used  to 
provide  training  In  take-off  and  landing  sufficient  to  meet  proficiency 
requirements  of  FAR  121.439.1-'  Take-off  and  landing  performance  in  the  air- 
craft of  80  simulator  trained  subjects  was  compared  with  that  of  80  control 
subjects  who  were  trained  under  FAR  121.439.  A variety  of  aircraft  types 
were  examined  (B-747,  DC-10,  B-707,  and  B-727),  and  all  simulator  program 
subjects  were  (a)  current  in  another  tjrpe  airline  aircraft  than  that  to 
which  being  trained  and  (b)  had  made  at  least  3 take-offs  and  landings  In 
the  preceding  24  months  In  the  type  aircraft  for  which  being  trained  (l.e., 
requallfled) . Training  was  to  proficiency,  and  the  first  two  landings  In 
operations  subsequent  to  the  training  served  as  the  transfer  trials. 

2.  Results 


a.  Time  to  proficiency  in  the  simulator  varied  from  35  minutes  to  2 
hours,  with  the  mean  time  being  1.1  hours. 

b.  Mean  time  to  proficiency  In  the  simulator  was  1.17  hours  for  Ss 
who  were  3-6  months  non-current;  1.05  hours  for  those  6-12  months  non- 
current;  and  1.08  hours  for  those  12-24  months  non-current. 

c.  Take-off  and  landing  grades  (5  point  scale)  in  the  aircraft  were  as 
follows  for  the  Control  and  Simulator  Groups: 


Months  Control  Simulator 


Non-Currency 

T-Off 

Ldg. 

T-Off 

Ldk. 

3-  6 

3.27 

3;  37 

3.69 

4.01 

6-12 

3.46 

3.44 

3.27 

3.33 

12-24 

3.07 

3.29 

3.31 

3.16 

>24 

3.13 

3.38 

- 

- 

Overall  Average 

3.33 

3.40 

3.49 

3.60 

3.  Conclusions 

a.  Training  in  the  simulator  was  equal  to  or  better  than  that  provided 
by  the  accomplishment  of  3 landings  in  the  airplane  (FAR  121.438). 

b.  Study  personnel  felt  that  the  pilot  should  have  a minimum  amount 
of  prior  experience  in  the  aircraft  type  (typically  recommended  100  hours) 
as  a prerequisite  to  substituting  the  simulator  training  for  aircraft  ex- 
perience required  under  FAR  121.439. 


— This  section  of  the  Federal  Air  Regulations  requires  that  to  function 
as  Pilot  In  Command  or  Second  in  Command  on  an  airliner,  the  pilot  must 
have  made  at  least  three  take-offs  and  three  landings  within  the  preceding 
90  days  'in  the  type  aircraft  in  which  he  Is  to  serve. 
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4.  Comment 


This  effort  was  not  a retention  study  In  the  sense  of  examining 
performance  after  a period  of  no  flying  activity;  subjects  were  current 
In  other  fleet  aircraft  and»  presumably,  were  regularly  engaging  In  fly- 
ing operations  as  pilots.  The  results  suggest  no  relationship  between 
the  length  of  the  non-currency  period  for  the  training  aircraft  and  per- 
formance in  that  aircraft  after  retraining,  but  this  observation  must  be 
examined  In  light  of  the  pilots*  flight  currency  In  other  aircraft.  The 
display  of  the  data  in  the  report  makes  detailed  Interpretation  difficult, 
because  no  significance  tests  are  used  and  the  size  of  certain  subgroups 
(e.g.,  by  non-currency  periods)  Is  not  given.  Also,  while  It  Is  felt  by 
the  authors  that  the  new  training  (l.e.,  with  the  simulator)  Is  equal  to 
that  under  FAR  121.439,  It  would  have  been  desirable  to  compare  their  per- 
formance with  another  control  group  who  received  no  training  at  all.  In 
the  background  section  of  the  report,  a graphical  display  is  given  of  aver- 
age simulator  and  aircraft  hours  to  transition  Captains,  for  several  air- 
craft and  for  several  years.  Because  of  their  Interest,  the  data  (esti- 
mated from  the  graph)  are  given  here. 


747  707  727  DC-10 


Year 

Sim 

AC 

Sim 

AC 

Sim 

AC 

Sim 

AC 

1966 

- 

- 

- 

18.0 

- 

21.0 

- 

- 

1967 

- 

- 

27.0 

12.5 

28.0 

12.5 

- 

- 

196S 

- 

- 

24.0 

10.2 

27.5 

8.1 

- 

- 

1969 

- 

- 

23.0 

7.5 

27.8 

8.0 

- 

- 

1970 

28.0 

5.5 

22.0 

5.6 

24.8 

6.0 

- 

- 

1971 

27.0 

5.0 

19.5 

3.5 

23.0 

3.5 

23.4 

3.5 

1972 

26.5 

3.6 

22.0 

2.9 

23.5 

3.1 

23.0 

2.7 

1973 

21.5 

3.4 

20.2 

2.0 

22.7 

2.9 

24.9 

2.2 

1974 

19.9 

2.0 

19.0 

1.2 

19.5 

1.2 

24.0 

1.6 

1975 

19.5 

1.8 

19.5 

1.3 

19.5 

1.0 

24.2 

1.6 

In  spite  of  Its  shortcomings  from  the  research  point  of  view,  this  report 
provides  significant  data  concerning  the  use  of  flight  simulators  to  re- 
quallfy  pilots  in  a difficult  skill  area,  that  of  take-off  and  landing. 

It  suggests  that  current  visual  simulation  technology  la  sufficiently 
advanced  that  significant  portions,  if  not  all,  of  the  major  USAF  re- 
training requirements.  Including  at  least  some  visual  reference  maneu- 
vers, can  be  trained  In  the  simulator.  This  Is  an  hypothesis  that  Is 
worthy  of  research  examination  by  the  USAF. 


7.  Anmons,  R.B..  Farr,  R.F.,  Bloch,  B.,  Neumann,  £.,  D.ey,  M. , Marlon,  R. , 
and  Anmons,  C.H.  ''Long~Term  Retention  of  Perceptual  Motor  Skills." 

J.  Exper.  Psychol..  1958,  55,  318-328. 


1.  Summary 

Retention  of  a procedural  skill  and  a compensatory  pursuit  skill  over 
time  Intervals  ranging  up  to  two  years  was  examined  in  a laboratory  setting. 
The  Independent  variables  were  amount  of  training  and  retention  Interval. 
Results  showed  time  to  execute  procedures  was  about  twice  as  large  after 
one  month  as  at  the  end  of  training  and  increased  by  a factor  of  3-4  by  the 
end  of  two  years.  Time-on-target  scores  on  the  pursuit  task  held  up  fairly 
well  for  up  to  six  months  for  those  Ss  who  received  more  training,  but  for 
those  with  less  original  training,  degradation  was  noticeable  at  six  months. 
Overall,  however,  it  was  found  that,  on  the  bases  of  mean  time  taken  per 
trial  or  percentage  time  on  target  per  trial,  absolute  loss  in  level  of  pro- 
ficiency was  apparently  not  affected  by  amount  of  training  and  was  greater 
the  longer  the  no-practlce  interval. 

2 . Comment 


This  is  one  of  the  most  elaborate  and  well-controlled  studies  of  long- 
term retention  in  the  literature.  It  involved  almost  1,000  subjects  and 
examined  fairly  long  retention  Intervals.  The  tasks  studies  bear  some  gen- 
eral relevance  to  pilot  control  tasks,  but  their  level  of  complexity  is  far 
from  that  which  would  allow  unqualified  generalization  to  mission  oriented 
USAF  pilot  control  tasks.  The  data  are  compatible,  in  general  terms,  with 
those  of  studies  more  directly  relevant  to  piloting  skills,  however,  and 
there  is  no  reason  here  to  conclude  that  simple  skills  and  complex  skills 
are  fundamentally  different  in  terms  of  their  retention  over  time.  While 
not  directly  analyzed,  the  data  do  support  the  thesis  that  procedural  skills 
show  greater  degradation  over  time  than  do  tracking  skills. 
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8.  Armstrong,  M.B.,  Bleymaler,  J.S.,  Hinkel,  J.F.,  Levins,  R. , and  Sheppard, 
R.R.  Flying  Skill  Retention  and  Proficiency  Flying.  Research  Report  No. 
009S»7S,  Air  Command  and  Staff  College,  Air  University,  Maxwell  AFB,  AL, 
May  1975. 


1,  Summary 

This  document  is  a broad  examination  of  USAF  proficiency  flying  programs 
In  view  of  existing  literature  on  retention  of  flying  skills.  The  effort 
was  conducted  in  connection  with  the  authors'  studies  at  the  Air  University 
and  at  Auburn  University.  An  extensive  review  of  the  background,  history, 
and  current  status  of  USAF  proficiency  flying  is  given,  along  with  a review 
of  selected  research  literature  on  general  skill  retention  and  literature 
on  flight  skill  retention. 

The  authors  touch  on  a wide  variety  of  bibliographic  sources  in  their 
report.  Some  41  items,  varying  from  newspaper  articles  to  research  reports 
to  AF  regulations,  are  cited  in  the  bibliography.  Detailed  summaries  of  12 
of  these  items,  studies  of  general  skill  retention,  are  given  in  an  appendix. 
Another  appendix  cites  30  references  as  being  "irrelevant"  to  their  study. 

In  spite  of  titles  that  sound  relevant. 

While  this  document  contains  a great  deal  of  information  of  considerable 
interest,  the  most  interesting  part  is  a chapter  detailing  certain  analyses 
of  data  concerning  the  retraining  of  USAF  POWs  returned  from  Vietnam.  They 
note  that  data  were  available  on  the  retraining  of  150  former  POWs  to  a pre- 
sumably equal  proficiency  level  in  T-37,  T-38,  and  T-39  aircraft.  Armstrong 
et  al  confined  their  analysis  to  the  retraining  records  of  96  pilots,  all 
retrained  In  the  T-38.  Their  analysis  examines  retraining  time  as  a function 
of:  (1)  hours  of  fighter  time;  (2)  hours  total  flying  time;  (3)  months  rated 
experience  prior  to  break  in  flying  (l.e.,  capture  as  POW) ; and  (4)  months 
in  non-flylng  status  (l.e.,  time  from  capture  to  beginning  of  T-38  retraining). 
Their  analysis  and  data  base  are  somewhat  more  extensive  than  that  reported 
by  Smith  and  Matheny,i'  the  only  other  published  source  found  on  USAF  POW 
retraining  during  the  present  review.  Raw  data  files  for  the  95  pilots  are 
presented  in  an  appendix  by  Armstrong  sX  al.,  along  with  regression  analyses. 

The  96  former  POWs  varied  from  50  to  6,322  hours  of  fighter  time  (M»l,159); 
from  304  to  7,747  hours  total  time  (M«2,100);  months  rated  prior  to  capture 
from  9 to  286  (M-^6).  Retraining  time,  under  the  highly  individualized,  on- 
demand  retraining  program,  ranged  from  12  to  95  hours  (IP‘45) . 

Results  showed  small  negative  correlations  between  hours  of  retraining 
time  and  all  variables  except  length  of  non-flylng  interval.  Of  the  nega- 
tive correlations,  only  that  with  total  fighter  time  was  statistically  sig- 
nificant (r  ” -.237;  p < .05).  The  correlation  of  non-flying  episode  and 
retraining  hours  was  also  statistically  significant  (r  - +.334;  p < .001). 

— ^ Smith,  J.F. , and  Matheny,  W.G.  Continuation  Versus  Recurrent  Pilot 
Training.  AFHRL-TR-76-4,  Air  Force  Human  Resources  Laboratory,  Brooks 
AFB,  TX,  May  1976. 
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From  the  diverse  sources  consulted  and  the  POW  data^  the  authors  con- 
clude that  a proficiency  flying  program  is  required  for  the  rated  supple- 
ment to  meet  readiness  requirements.  They  provide  suggested  characteristics 
of  such  a program,  and  a model  or  program  for  determining  who  should  go  Into 
the  rated  supplement  and,  further,  who  should  be  identified  as  surge,  draw- 
down, and  controlled  rotation. 

2.  Comment 


This  a very  ambitious  paper.  While  the  task  the  authors  set  them- 
selves was  a large  one,  they  gave  the  subject  a good  examination.  The  leap 
from  data  to  conclusions  to  recommendations  was  extensive,  and  one  might  de- 
bate the  validity  thereof.  The  principal  value  of  this  document  is  not  its 
review  of  the  research  literature,  but  the  good  overview  of  the  entire  sub- 
ject of  USAF  proficiency  flying  it  provides  and  the  exposition  of  the  POW 
retraining  data.  Some  of  the  correlational  analyses  are  not  appropriate 
due  to  discontinuities  in  the  data,  and  the  authors  recognize  chat  any  re- 
lationships found  in  these  data  may  be  significantly  colored  by  the  "over- 
riding psychological  factors  of  the  many  readjustments  and  other  pressing 
interests  of  the  POWs  during  the  retraining  period."  They  then  use  this 
rationalization,  seemingly,  to  support  interpretations  ,that  are  more  in  line 
with  their  expectations.  In  spite  of  this,  Armstrong  et  al  have  provided  a 
rather  significant  document  on  the  topic  of  proficiency  flying. 
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Caines,  K.L.D.,  and  Danoff,  M.N.  Proficiency  Flying  Program  Study.  PRC-R- 
952,  Planning  Research  Corporation,  Los  Angeles,  CA,  March  1967. 


1.  Description 

This  study,  conducted  for  OASD(SA),  had  two  objectives:  (1)  to  deter* 

mine  the  proficiency  level  of  pilots  who  had  been  taking  part  in  profi- 
ciency flying  programs  while  in  administrative  assignments;  and  (2)  to 
develop  cost-effective  training  programs  and  equipment  for  alternative 
proficiency  flying  programs.  The  method  Involved  examination  of  the  train- 
ing records  of  178  pilots:  84  USAF  pilots  who  had  gone  through  F-4C  CCTS 

training;  17  USN  aviators  who  had  gone  through  A-4E  CRAW  training;  and  78 
USAF  pilots  who  had  gone  through  C*130B  CCTS  training.  The  basic  unit  of 
analysis  was  number  of  deficiencies  (by  mission  or  flight  segment  or  ele- 
ment) per  100  flights.  Pilot  proficiency  degradation  areas  attributable 
to  proficiency  flying  were  identified  by  comparing  records  of  those  who 
had  been  on  proficiency  flying  assignments  (varying  from  0.5  to  5.0  years) 
just  prior  to  CCTS  or  CRAW  with  records  of  those  who  went  to  CCTS  or  CRAW 
from  a cockpit  assignment  that  Involved  flying  duty.  Most  comparisons  were 
based  on  CCTS  training  involving  an  aircraft  type  different  from  that  flown 
before  CCTS  or  proficiency  flying. 

2.  Results 

(a)  Pilots  who  had  been  in  proficiency  flying  assignments  exhibited 
significantly  more  deficiencies  per  100  training  flights  than  did  those 
who  had  not  been  in  proficiency  assignments. 

(b)  Areas  of  significant  deficiency  included  takeoff,  general  airwork, 
navigation,  tactical  formation,  bombing,  tactics,  and  normal  landing. 

(c)  Tasks  involving  high  information  volume  and  rate  with  simultaneous 
motor  requirements  were  areas  of  deficiency. 

(d)  Pilots  who  had  been  in  proficiency  flying  for  more  than  2 years 
had  significantly  more  deficiencies  than  those  with  less  than  2 years. 

3.  Conclusions 

(a)  Proficiency  pilots  are  lees  proficient  than  pilots  who  have  been 
in  flying  assignments. 

(b)  Proficiency  flying  programs  need  to  be  changed  to  remedy  defi- 
ciencies and  to  upgrade,  readiness. 

4.  Comment 


This  study  was  undertaken  with  an  expectation  that  pilots  who  had  been 
in  proficiency  flying  assignments  would  show  performance  deficiencies  In 
CCTS  or  CRAW  training.  That  expectation  was  fulfilled.  The  data  leave 
much  to  be  desired.  For  example,  the  bulk  of  the  comparisons  made  involve 


pllota  who  had  previously  flovm  an  aircraft  type  different  from  that  used 
In  CCTS  training.  Also,  C-130  data  were  for  the  final  checkrlde  flight 
only,  whereas  F-4  and  A-4  data  were  for  training  flights  only.  The  data 
displays  do  not  allow  the  reader  to  examine  in  detail  the  rationale  for 
conclusions  reached.  The  procedure  used  assumes  that  all  pilot  groups  were 
at  equivalent  proficiency  levels  at  the  end  of  their  last  cockpit  flying 
assignment  and/or  CCTS  training.  While  the  basic  conclusions  of  the  study 
may  be  valid,  their  underpinning,  in  terms  of  data  displayed,  could  be 
stronger, 


26.  Cotterman,  T.E.  and  Wood,  M.E.  Retantlon  of  Simulated  Lunar  Landtn& 

Mission  Skill;  A Test  of  Pilot  Raliabllity.  Aerospace  Medical  Research 
Laboratories,  Technical  Report  No.  AMRL-TDR-66-222,  Wright-Pat ter son  AFB, 
OH,  April  1967. 


1.  Description 

This  study  was  part  of  NASA's  program  of  research  on  long-term  skill 
retention.  Specifically,  the  effects  of  no-practice  periods  of  up  to  3 
months  on  the  retention  of  lunar  landing  mission  skills  were  examined.  Four 
three-man  crews  served  as  subjects.  All  were  graduates  of  the  Aerospace 
Reseat ch  Pilots  School.  Following  five  weeks  of  premission  training  on 
various  aspects  of  the  mission,  each  crew  performed  the  full  lunar  landing 
mission  requiring  169  hours.  Full  size  simulations  of  the  Apollo  Command 
Module  and  the  Lunar  Excursion  Module  were  used.  One  crew  was  tested  for 
retention  after  4 weeks;  another  after  8 weeks;  another  after  9 weeks;  and 
another  after  13  weeks.  Retention  trials  were  done  In  fast  time,  i.e., 
they  took  only  13  hours  due  to  elimination  of  the  long  translunar  and  trans- 
earth coast  periods.  A wide  variety  of  performance  measures  was  used  In 
this  Investigation,  with  most  lending  themselves  to  summarization  as  mission/ 
phase  probability  of  success. 

2.  Results 


a.  The  four  crews  achieved  variable  levels  of  skill  in  their  original 
training. 

b.  All  crews  exhibited  decrements  in  performance  after  the  no-practlce 
Interval. 

c.  No  difference  In  degree  of  decrement  was  found  between  the  8-weeks 
and  13-weeks  retention  interval. 

d.  Crewmembers  tested  second  or  third  seemed  to  benefit  from  the  oppor- 
tunity of  viewing  (and  participating  In)  the  first  crewmember's  testing. 

3.  Conclusions 

a.  "...  It  seems  fair  to  conclude  from  the  present  study  that  with- 
out special  design  attention  operator  reliabilities  in  critical  tasks  per- 
formed after  8 weeks  or  more  without  prior  direct  familiarization  are  likely 
to  be  unacceptable." 

b.  Pilot  performance  reliability  can  be  made  sufficiently  high  through 
appropriate  training  to  permit  successful  execution  of  extended  spaceflight 
missions  of  the  type  studied  here. 

4 . Comment 


This  Is  the  most  elaborate  of  all  the  retention  studies  examined.  The 
task  was  exceedingly  complex  and  lengthy,  and  the  equipment,  instrumenta- 
tion, and  data  used  were  also  the  most  complex.  However,  there  are  a number 
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of  factors  that  make  gonerallsatlon  of  these  results  to  the  aircraft  pilot~ 
Ing  skills  retention  problem  somewhat  difficult.  First,  only  four  crews 
were  Involved,  one  to  each  retention  interval.  Second,  the  sunmary  relia- 
bility data  are  difficult  to  translate  into  task  details.  The  fact  that 
the  various  crews  apparently  were  not  trained  to  the  aamo  level  of  original 
skill  makes  it  difficult  to  assess  the  effects  of  retention  interval  since 
there  was  only  one  crew  per  Interval.  And,  finally,  there  is  no  way  to 
assess  the  effects  of  the  various  activities  of  these  military  test  pilots 
that  were  Interpolated  between  the  original  training  and  the  retention  test. 
Nevertheless,  this  is  an  Important,  pioneering  effort  that  provided  highly 
valuable  input  to  the  successful  spaceflight  program. 


Flslshtnan,  E.A.»  and  Parker,  J.F. , Jr.  '’Factors  In  the  Retention  and 
Relearning  of  Perceptual-Motor  Skill."  J.  Exper.  Psychol..  1962,  64. 
215-226. 

Also  published  as:  Parker,  J.F.  Jr.,  and  Fleishman,  E.A.  The  Retention 

of  a Cknitinuous  Control  Perceptual -Motor  Skill.  Technical  Report  PRA  60-37, 
0??lceoinSSv^  Research,  Washihgton,  DC,  July  1960. 


1.  Description 

This  study  investigated  the  effects  of  retention  interval,  amount  and 
type  of  initial  training,  and  type  of  retraining  on  retention  and  relearn- 
ing. Two  groups  of  subjects  were  given  extended  training  on  a highly  com- 
plex tracking  task — a simulated  radar  intercept  mission.  Practice  extended 
over  17  sessions  distributed  over  6 weeks.  The  groups  differed  only  in  the 
amount  of  verbal  guidance  provided  in  initial  training.  Within  each  group, 
subgroups  of  subjects  matched  for  final  proficiency  were  retested  following 
various  no-practlce  Intervals  of  up  to  24  months.  These  retention  samples 
were  further  divided  into  two  subgroups,  each  of  which  was  given  four  addi- 
tional retraining  sessions.  In  one  group,  this  relearning  practice  was 
massed  in  one  day,  and  for  the  other  group,  it  was  distributed  over  four 
days.  One  week  following  the  retraining  all  subjects  were  retested  as  a 
means  of  evaluating  the  persistence  of  the  effects  of  these  two  relearning 
schedules . 

2.  Results 

a.  The  retention  of  proficiency  In  a complex,  continuous  control,  per- 
ceptual-motor skill  is  extremely  high,  even  for  no-practlce  Intervals  up 

to  24  months. 

b.  Variations  in  retention  Interval  from  1 to  14  months  are  shown  to 
be  unrelated  to  retention  performance,  even  during  the  first  1 minute  of 
relearning.  The  function  has  zero  slope  until  the  loss  in  performance  shown 
by  the  24-month  retention  group. 

c.  The  most  Important  factor  in  retention  is  the  level  of  proficiency 
achieved  by  the  subjects  during  initial  learning.  This  effect  is  shown  to 
be  just,  as  important  following  long  and  short  periods  of  no  practice. 

d.  The  type  of  initial  training  (amount  of  verbal  guidance)  is  unre- 
lated to  retention  performance  when  proficiency  level  after  original  learn- 
ing is  held  constant. 

e.  Retraining  administered  under  conditions  of  distributed  practice 
was  superior  to  that  administered  under  mass  practice,  though  on  retesting 
1 week  later  no  difference  was  noted  between  the  two  retraining  procedures. 

f.  Predictions  of  individual  differences  in  retention  from  independent 
ability  measures  were  negligible.  Retention  appears  more  a function  of 
specific  task  habits  acquired,  than  of  subjects'  ability  traits  developed 
prior  to  training. 
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g.  The  correlation  between  Indlvlduale'  performance  levels  at  the  end 
of  Initial  training  and  after  the  retention  interval  was  quite  high,  vary- 
ing from  a low  of  r - .80  for  Group  I (no  formal  guidance  training)  at  tl^e 
24-month  Interval  to  a high  of  r .98  fur  Group  II  (formal  guidance  train- 
ing) at  the  9-month  interval. 

3.  Conclusions 


a.  The  atudy  conflrmst  using  a complex  continuous  control  tafk,  the 
evidence  from  previous  studies  Chat  perceptual-motor  skills  are  well  re- 
tained for  periods  of  no  practice  up  to  24  months. 

b.  The  data  Indicate  a subsjtantlal  loss  between  14  and  24  monthf, 
but  Che  lost  skill  was  quickly  regained  through  retraining. 

c.  Level  of  Initial  proficiency  Is  a prime  determiner  of  level  pf 
skill  retention. 


d.  There  is  considerable  stability  of  relative  skill  levels  by  group 
members  over  extended  periods  of  no  practice. 

4.  Comment 

This  well-designed  and  executed  study  lends  support  to  the  contention 
that  basic  perceptual-motor  skills,  such  as  those  Involved  In  piloting  an 
aircraft,  qhow  relatively  little  decrement  for  no-practice  periods  up  to 
24  months  and  that  such  loss  as  occurs  Is  quickly  restored  by  retraining. 

The  stability  of  the  Individual's  performance  level  over  time  relative  to 
that  of  others  in  his  group  might,  if  substantiated  for  actual  flight  skills, 
lend  support  to  a program  of  selective  identification  (based  on  relative 
proficiency  level  prior  to  a non-flying  episode)  of  pilots  to  be  retrained 
after  non-flying  periods. 
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Also  avatlabls  aa:  Schrady,  D.A.  and  Hanlsy,  M>J.  A Coapayati.va  Analysis 

of  Proflcisncv  Aviator  Skill.  Knowledge,  and  8atlsgactlqn>  (Faculty  Research 
fro“jsctV^^  Nbntersy,  CA,  March  1971. 


PascrtPtjon 

This  study  sought  to  exas^na  efgects  on  flight  proficiency  of  a 
4-hour  pay  aonth  profiplenpy  flying  reglqien  versut  an  8-hour  per  month 
raglman.  guhjscts  were  Naval  avtatpra  ybo  wars  la  CRT  statue  as  students 
at  the  0.  8,  Naval  Postgraduate  School.  Three  types  of  data  were  collsc- 
teS:  (a)  attltudea  toward  CRT  and  the  T-1  alrpraftJ  (b)  Rnowledge  of 

T-1  aystems  and  procedures;  and  (c)  inflight  performance  utilising  a seml- 
objsctlva  flight  checklist,  night  performance  of  the  two  groups  was  com- 
pars^  under  prs-  and  post-test  design  over  a period  of  approximately  six 
months. 

2.  Results 

a.  Both  the  4-hour  and  8-hour  CRT  groups  felt  4 hours  per  month  wap 
inadequate  to  practice  mission  skills  and  maintain  proficiency. 

b.  The  8-hour  group  exhibited  scores  on  the  T-1  systems  examination 
that  were  atatlstlcally  significantly  higher  than  thope  of  the  4-hour  group* 

c.  Flight  performance  scores  favored  the  8-hour  group,  but  differences 
were  not  statistically  significant. 

3.  Conclusions 

In  spite  of  the  non-significant  differences  in  flight  performance,  the 
author  concludes  that:  "The  shthor  is  of  the,  opinion  that  the  8-hpur  group 

is  indeed  more  skillful  than  the  4-hour  group."  This  opinion  was  based  on 
the  belief  that  the  significance  of  differences  yas  obscured  by  the  greater 
performance  variability  exhibited  by  the  8-hour  group , 

4.  Comment 

While  this  la  one  of  the  vary  few  studies  of  proficiency  flying  in 
which  inif light  performance  data  have  been  gathered,  it  suffers  from  a 
number  of  metbodologlcal  problems.  Of  course,  it  is  pertinent  to  choosing 
among  proficiency  flying  progray  alternatlvee,  hut  it  has  little  relevance 
to  the  subject  of  long-term  retention  of  flying  skills.  However,  it  was 
an  ambitious  study  for  tbs  circumstancea,  and  ita  use  o*  somewRat  more 
objective  means  of  sssssslng  inflight  pilot  performance  ie  a procedure 
much  to  be  encouraged. 
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HoXllater,  W.M. , LaPointe,  A.,  Oman,  C.M. , and  Tole,  J.R.  Identifying 
and  Determining  Skill  Degradations  of  Private  and  Commercial  Pilots. 
FAA-RD-73-91,  MIT  Measurement  Systems  Laboratory,  Cambridge,  MA,  June  1973. 


1.  Description 

This  study  sought  to  measure  skill  degradation  for  a sample  of  55 
non-instrument  rated,  single-engine  certificated  private  and  commercial 
pilots  as  a function  of  several  experience  factors,  primarily  indices 
of  recency  of  flight  experience.  Ss  were  administered  three  test  flights 
during  which  grades  were  assigned  to  flight  segments  utilizing  a slx-polnt 
subjective  rating  scale.  Flight  data  were  then  related  to  various  exper- 
ience Indices  through  a stepwise  regression  analysis. 

2.  Results 

a.  Overall  flight  grade  was  positively  related  to  aircraft  type 
recency. 

b.  Overall  flight  grade  was  positively  related  to  total  flight  time. 

c.  Overall  flight  grade  was  negatively  related  to  years  since  cer- 
tification. 

d.  Overall  flight  grade  was  positively  related  to  time  in  aircraft 
type. 

e.  Overall  flight  grade  was  negatively  related  to  pilot's  age. 

f.  The  five  experience  variables  used  accounted  for  only  24%  of  the 
variance  in  flight  performance. 

3.  Conclusions 


a.  Prediction  of  an  Individual  pilot's  skill  based  only  on  experience 
factors  is  unreliable. 

b.  The  most  important  experience  factor  in  predicting  flight  skill 

is  recency  of  flight  experience  (defined  as  approximately  the  average  rate 
at  which  the  skill  is  practiced) . 

c.  The  logarithm  of  total  time  is  also  useful  in  predicting  skill 
from  experience. 

d.  Skill  decreases  as  a function  of  years  sfnce  certification. 

e.  No  relationships  were  found  between  the  following  factors  and 

flight  skill:  score  on  written  quizzes;  subject's  own  assessment  of 

skill;  geographic  factors;  and  type  of  initial  training. 

f.  Highest  grades  were  received  on  those  aspects  of  flight  practiced 
most  often,  such  as  preflight  and  take-off,  while  lowest  scores  were  re- 
ceived on  infrequently  practiced  aspects  such  as  stalls  and  instrument 
flight. 
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4.  Comment 


This  study  presents  en  interesting  approach  to  skill  degradation.  The 
method  for  computing  recency  of  experience  is  worthy  of  note.  However, 
the  study  design  was  not  set  up  to  examine  retention  over  any  specified 
non-flying  interval,  other'than  that  one-third  of  the  subjects  had  an 
elapsed  time  since  last  flight  of  less  than  two  weeks,  a third  from  two 
to  six  weeks,  and  a third  more  than  six  weeks.  There  was,  apparently,  no 
attempt  to  limit  other  flying  activities  during  the  period  of  the  three 
data  flights,  though  such  flights  were  entered  into  recency  calculations. 
Also,  as  noted  at  least  by  inference  by  the  authors,  the  subjective  grading 
system  could  have  introduced  a significant  amount  of  error  variance  into 
the  flight  teat  data.  This  study  Is  descriptive,  rather  than  experimental, 
and,  while  the  results  sound  logical,  the  data  would  require  verification 
before  one  might  assume  their  generality  to  all  flight  situations.  There 
are  obvious  differences  from  current  USAF  flight  situations  — a different 
subject  population,  lower  skill  levels,  a much  simpler  flight  task,  reten- 
tion time  Intervals,  etc.  — but  this  study  would  seem  to  offer  an  approach 
that  has  merit,  and  USAF  might  do  well  to  pursue  this  research  methodology 
further  in  a more  pertinent  flight  context. 


i 

( 


III-19 


53. 


HumRRO  Division  No,  6 (Aviation).  A Test  of  Synthetic  Training  In 
Combat  Readiness  Proficiency  Training.  Unpublished  Internal  Research 
Report,  Hunan  Resources  Research  Organization,  Fort  Rucker,  AI>,  June 
1974. 


1.  Description 

This  was  a pilot  study  of  the  use  of  a high  fidelity  helicopter 
simulator  (no  visual  system)  In  programs  for  maintaining  flight  pro- 
ficiency and  for  retraining  after  non-flying  periods.  Three  groups 
of  Army  aviators  received  training  in  the  simulator  to  proficiency 
levels  required  to  pass  the  standard  instrument  checkrlde.  The  groups 
were:  (a)  aviators  holding  current  cockpit  assignments  (N  « 10);  (b) 

aviators  who  had  been  In  proficiency  flying  status,  l.e.,  80  hours  per 
year  (N  “ 10) ; and  (c)  aviators  who  had  been  In  non-flying  status  for 
periods  of  9-24  months  (N  10),  Each  subject  received  an  initial 
diagnostic  checkrlde  in  the  simulator  and  then  received  an  individual- 
ized, proflclency-paced  training  program  designed  to  bring  his  proficiency 
up  to  the  level  required  to  pass  the  instrument  checkrlde.  Following 
successful  completion  of  the  simulator  check,  each  participant  was  given 
the  same  Instrument  checkrlde  In  the  UH-1  aircraft.  Each  then  received 
a diagnostic  contact  checkrlde  In  the  aircraft  and  such  training  as  was 
necessary  to  pass  the  contact  maneuver  checkrlde  In  the  aircraft. 

2.  Results 


a.  Mean  hours  of  simulator  time  required  by  each  group  (including 
hours  devoted  to  simulator  Instrument  checkrldes)  were  as  follows: 

Group  A ■ 6.2;  Group  B » 11.4;  and  Group  C • 11 . 7 . 

b.  Mean  instrument  hours  required  In  the  aircraft  to  pass  the  In- 
strument checkrlde  were  as  follows:  Group  A - 2.2;  Group  B “ 2.6;  Group 

C - 2.6. 


c.  Mean  contact  hours  required  In  the  aircraft  to  pass  the  contact 

checkrlde  were:  Group  A ■ 1.7;  Group  B « 2.1;  and  Group  C • 2.6. 

d.  Variability  in  total  time  required  among  Individuals  In  the  various 
groups  was  approximately  half  as  great  for  Group  A as  It  was  for  Groups  B 
and  C,  with  the  bulk  of  this  difference  being  peculiar  to  variations  In 
time  required  In  the  simulator. 

3.  Conclusions 


a.  Aviators  In  current  flying  assignments  required  only  about  half 
as  much  tln»  to  reach  required  proficiency  levels  as  those  who  had  been 
In  proficiency  flying  or  non-flying  status.  There  was  little  practical 
difference  between  the  latter  two  groupq. 

b.  The  proficiency  losses  from  the  approximately  one  year  of  non- 
flying or  proficiency  flying  are  not  large  In  a practical  sense  (approxi- 
mately 6 hours  retraining  time)  when  compare^  with  times  required  to  reach 
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proficiency  by  aviators  in  current  flying  assignments. 

c.  The  simulator  is  an  appropriate  means  to  provide  virtually  all 
the  retraining  necessary  for  normal  instrument  and  contact  operations  In 
the  hellcQpter. 

d.  Through  efficient  simulator  training,  proficiency  differences  among 
the  groups  (which  were  in  the  expected  directions)  can  be  largely  confined 
to  the  simulator. 

e.  Achieving  proficiency  in  this  helicopter  simulator  allows  predic- 
tion with  high  confidence  that  the  Individual  can  demonstrate  proficiency 
in  the  helicopter  with  little  aircraft  training  required. 

f.  Restoration  of  Instrument  proficiency  in  the  simulator  provides 
benefits  to  contact  performance  in  the  aircraft. 

k.  Comment 

This  was  a small-scale  study,  and  the  conclusions  must  be  viewed  as 
suggestive  rather  than  definitive.  Nevertheless,  4t  provides  evidence 
that  (a)  subjects  who  had  engaged  in  proficiency  flying  programs  were 
little  better  off  than  those  who  had  not  flown  at  all,  and  (b)  both  these 
groups  were  able  to  regain  necessary  proficiency  in  the  simulator  and  in 
relatively  little  time.  It  is  of  interest  to  note  that  the  total  simula- 
tor plus  aircraft  time  required  by  Groups  B and  C (16-17  hours)  is  very 
similar,  to  the  retraining  time  reported  by  non-flying  respondents  In 
Wright's  Btudyl.'  of  helicopter  pilots.  Of  course,  it  must  be  kept  in  mind 
chat  this  study  was  concerned  only  with  the  establishment  or  retraining  of 
basic  contact  and  Instrument  proficiency  levels.  It  did  not  deal  with 
tactical  mission  skills  such  as  weapons  delivery  and  nap-of-the-earth 
flight  and  navigation.  It  does  indicate,  however,  a high  level  of  skill 
retention  after  extended  periods  of  non-flying  and  the  feasibility  of 
reliance  on  the  simulator  as  a major  retraining  means. 


1/ 

— Wright,  R.H.  Retention  of  Flying  Skills  and  Refresher  Training  Re- 
quirements; Effects  of  Non-Flying  and  Proficiency  Flying.  HumRRO  Technical 
Report  73-22,  Human  Resources  Research  Organization,  Alexandria,  VA,  Dec- 
ember 1973. 
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55.  Killian,  D.C.  Pilot  Protlclancy  Ratantlon  for  United  Air  Llnea  Sacond 
Officers.  United  Air  Lines,  Inc. , February  1^65. 


1.  Summary 

Questionnaires  were  administered  to  109  second  officers  who  had  re~ 
cently  upgraded  to  first  officer  status  after  an  average  time  of  8 years 
as  second  officer.  Flight  managers  were  also  queried  concerning  the  up- 
grading of  these  pilots.  Findings  are  difficult  to  Interpret  with  re- 
erence  to  non-flying  retention,  because  many  of  the  second  offlc«c8  (over 
half)  were  flying  In  military  units  or  in  other  capacities  during  their 
service  as  second  officer.  However,  the  author  reports  the  second  offi- 
cers "had  no  problem  upgrading  to  the  position  of  first  officer."  No 
substantial  difference  was  found  in  the  performance  of  second  officers 
with  less  than  1,000  hours  and  chose  with  more  than  1,000  hours.  In 
sumsary  of  the  retention  area,  the  author  states:  "It  would  appear,  there- 

fore, that  the  pilot  skills  desired  of  an  airline  first  officer  consist  of 
many  factors,  many  of  which  can  be  retained  and.  In  fact,  enhanced  by  other 
activities  than  actual  "stick  and  rudder"  practice." 

2 . Conanent 


This  study  suggests  that  long-term  retention  of  basic  flight  skills 
Is  good  and  that  a program  of  simulator  training  will  reinstate  skills  to 
acceptable  levels.  Reference  is  made  to  procedures,  communications,  and 
Instrument  flying  skills  as  areas  of  greatest  decrement.  However,  this 
study  of  retention  time  factors  did  not  have  sufficient  experimental  con- 
trols to  make  the  results  of  great  interest  to  current  USAF  problems. 
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Kusewltt,  J.B.  Combat  Readiness  Training  (CRT)  Study  (U) . Report  2-55100/ 
8R"»50450.  Prepared  for  the  Deputy  Chief  of  Naval  Operations  (Air),  Vought 
Aeronautics  Division,  LTV  Aerospace  Corporation,  Dallas,  TX,  August  1968 
(CONFIDENTIAL) . 


1.  Summary 

This  study  was  a comprehensive  analysis  of  the  Navy's  overall  flight 
proficiency  program  to  determine  Its  value,  need,  and  cost  effectiveness. 
Possible  improvements  to  the  CRT  program  were  discussed.  Most  of  the  in- 
formation given  in  the  report  is  unclassified,  and  only  unclassified  por- 
tions will  be  discussed  here.  Data  sources  of  great  variety  were  used, 
including  costs,  accidents,  refresher  training,  and  a survey  of  some  1,600 
Naval  aviators  and  324  Naval  flight  officers  concerning  the  relationship 
of  various  CRT  alternatives  to  their  career  plans.  General  conclusions 
were  as  follows: 

a.  The  CRT  program  was  cost  effective,  with  benefits  exceeding  costs 
by  a ratio  of  3-4  to  1. 

b.  Lack  of  a CRT  program  would  have  a negative  Impact  on  career  re- 
talnabllity  of  Naval  aviation  personnel. 

c.  Refresher  training  savings  as  great  as  37  hours  per  aviator  are 
possible  when  CRT  and  refresher  training  are  in  the  same  model  aircraft. 

d.  Absence  of  CRT  would  have  a negative,  Impact  on  force  reaction  time, 
voluntary  groundings,  and  accidents  in  refresher  training. 

e.  Insufficient  data  existed  to  ascertain  the  value  of  either  academic 
ground  training  or  simulator  training  to  the  maintenance  of  flying  profi- 
ciency. 

2.  Comment 

This  was  an  extensive  examination  of  Navy  CRT  programs,  perhaps  the 
most  extensive  examination  of  any  of  the  military  services.  It  was  con- 
ducted with  an  orientation  toward  developing  an  improved  CRT  program,  so 
it  is  not  surprising  that  it  should  conclude  that  CRT  is  a good  thing. 

The  scope  of  the  effort  was  quite  comprehensive,  and  it  seems  to  have  been 
performed  with  competence.  As  with  many  cost-effectiveness  studies,  the 
quality  of  individual  data  Inputs  may  be  questioned.  For  example,  the 
method  of  deriving  a "forgetting  function"  or  the  assumption  that  CRAW 
training  time  data  and  grades  are  unbiased  can  be  questioned.  Certainly, 
the  integration  of  behavioral  science  research  background  into  the  study 
was  minimal.  Nevertheless,  in  spite  of  the  bias  toward  support  of  CRT 
programs  and  data  questions,  this  was  a major  effort  that  was  done  well, 
and  which  provides  much  worthwhile  information  and  examples  of  methodol- 
ogy. While  its  orientation  toward  behavioral  science  is  minimal,  the 
reader  interested  in  a comprehensive  view  of  proficiency  maintenance 
questions  would  do  well  to  examine  this  document. 
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Mfengelkoch,  R.F.,  Adams,  J.A,  and  Gainer,  C.A.  The  Forgetting  of  Instru- 
ment Flying  Skills  as  a Function  of  the  Level  of  Initial  Froficlency. 
NAVTRADEVCEN  Technical  Report  71-16-18,  U,  sT  Navel  Training  Device  Center, 
Port  Washington,  NY,  1960. 


1.  Description 

The  objective  of  this  study,  which  Involved  a variety  of  complex  simu- 
lated flight  tasks,  was  to  investigate  the  effects  of  amount  of  training 
on  the  forgetting  of  instrument  procedural  and  control  skills.  Two  groups 
of  13  subjects  each  were  given  4 hours  of  classroom  instruction,  one  famil- 
iarization "flight,'*  and  then  either  5 or  10  training  flights  of  50  minutes* 
duration.  The  subject  task  consisted  of  IFR  flight  control  and  execution 
of  all  normal  procedures  from  engine  start-up  through  shutdown  of  the  50- 
mlnute  structured  flight.  A moving  base  (Link  l-CA-2)  flight  simulator 
configured  to  represent  the  SNJ  aircraft  was  used.  After  a four-month 
Interval,  four  retraining  trials  were  given.  Performance  parameters  meas- 
ured included  120  procedural  items  and  five  flight  control  items  measured 
every  10  seconds;  altitude,  bank,  airspeed,  level-cff  at  altitude,  roll-out 
on  new  heading.  The  120  procedures  items  consisted  of  three  categories  of 
procedures;  (a)  static  - those  not  requiring  concurrent  flight  control;  (b) 
dynamic  - those  requiring  concurrent  flight  control;  and  (c)  emergency  - 
those  requiring  concurrent  flight  control  and  cues  for  which  were  presented 
without  warning. 

2.  Results 

a.  Procedural  skills  showed  significant  retention  losses  over  the  four 
; months  period  for  both  training  groups.  Loss  was  relatively  greatest  for 

static  procedures  and  least  for  dynamic  procedures. 

b.  Statistically  significant  losses  were  shown  for  altitude  and  air- 
speed control  for  both  groups  and  for  bank  control  for  the  group  with  less 
original  training.  However,  the  mean  error  increase  In  these  parameters 

was  not  of  practical  sigrtificance  (e.g.,  altitude  <20  ft.;  bank  <0.5  degrees; 
and  airspeed  1-2.4  MPH) . 

c.  Groups  with  five  and  ten  50-mlnute  training  trials  showed  similar 
amounts  of  forgetting  for  most  measures  of  flying  proficiency.  This  meant 
that  the  group  with  the  greatest  amount  of  Initial  training  had  the  highest 
performance  level  after  the  retention  interval,  since  Its  performance  at 
the  end  of  training  was  better. 

d.  The  number  of  trials  taken  to  relearn  to,  the  level  of  the  profi- 
ciency attained  on  the  final  training  trial  is  fewer  than  that  taken  ori- 
ginally. 


e.  The  number  of  trials  taken  to  relearn  is  a positive  function  of 
the  amount  of  initial  training. 

f.  One  difference  from  laboratory  studies  using  relatively  simply  pro-  - 
cedural  and  training  tasks  was  that  the  relatively  complex  Operational  Flight 
Trainer  (OFT)  tasks  required  a much  longer  time  to  relearn. 
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3 • Conclualons 

a.  "The  most  Important  implication  for  operational  flight  training 
is  that  procedural  responses  show  retention  losses  that  are  not  only 
statistically  but  practically  (operationally)  significant  whereas  mea8~ 
urea  of  proficiency  (loss)  for  flight  parameters  are  operationally  insig- 
nificant throughout,  even  in  the  Instances  when  they  are  statistically 
significant." 

b.  "The  findings  of  this  study  strongly  suggest  that  programs  direc- 
ted toward  the  maintenance  of  flying  proficiency  should  focus  on  tha 
training  of  procedures." 

c.  Many  procedures  can  be  taught  in  a classroom  with  simple  training 
aids,  but  others  can  profitably  use  either  a cockpit  procedures  trainer, 
a general  Instrument  flight  trainer,  or  an  OFT. 

d.  Vfhen  the  costs  of  an  OFT  are  not  feasible  for  a program,  a com- 
bination of  general  Inscrument  flight  trainer  and  a cockpit  procedures 
trainer  should  be  considered. 

4 . Comment 


This  is  one  of  the  best  of  the  direct  studies  of  flight  task  retention, 
though  it  must  be  kept  in  mind  that  all  data  concern  simulation  performance. 
However,  generalization  of  the  results  to  aircraft  performance  is  probably 
reasonable.  The  task  studied  was  complex  and  realistic  and  the  performance 
measures  used  were  comprehensive.  The  principal  deficiencies  of  the  study, 
as  it  relates  to  current  USAF  concern,  is  that  level  of  training  did  not 
approach  that  of  the  typical  experienced  USAF  pilot  entering  a non-flying 
episode  and  the  four-month  retention  Interval  Is  much  shorter  than  the 
typical  non-flying  period  of  concern.  Even  so,  the  conclusion  concerning 
the  differential  forgetting  of  procedural  and  control  skills,  and  means  of 
maintaining  proficiency  or  reinstating  It,  are  pertinent  to  current  USAF 
problems. 
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73.  Naylor,  J.C.,  9rlgga,  G,E.,  and  Road,  W.C.  Tha  Efgacta  of  'y'aak  Organiaa- 

tion^  Training  Time,  and  Ratreotioo  Intaryal  oo  tha  Ratantion 
ANRL''^R>6^  6570cb  Wroapaca  Madicai  liiaa'iarch ' 'tabora  tor  lea ,'  Air  Forea 

Syaeapa  Connuiind,  Wright -P^t;carion  APB,  OH,  Septanbar  1962. 

74.  This  rasaarch  also  raportad  In:  Naylor,  J.C.,  Brigga,  G.E.  and  Read,  W.G. 

"Taak  Coharanca,  Training  Tima,  and  Ratantion  Interval  Effects  on  Skill 
Rataption."  J.  Appl.  Psychol..  1968,  386-393. 


1.  Daserlpclon 

As  part  of  U8AF  research  on  long-term  ratentlop,  three  variables 
(amount  of  training,  task  organisation,  and  length  of  retention  Interval) 
ifsra  examined  for  their  Influence  on  long-term  retention.  The  criterion 
tack  involved  tim'^-shared  activity  between  a three-dimensional  compensa- 
tory tracking  task  and  a discrete  procedural  task.  Eight  groups  of  16 
subjects  each  received  (a)  2 or  3 weeks  of  training  on  (b)  tasks  of  high 
or  low  organisation,  and  (c)  were  tested  after  retention  intervals  of  1 
or  4 weeks,  Task  organisation  of  the  secondary  procedural  task  had  to  do 
with  the  epatlal  predictability  of  a group  of  signal  lights  being  moni- 
tored. 

2.  Results 

a.  Learning  ip  more  rapid  with  high  organisation  tasks, 

b.  Retention  varied  directly  with  level  of  training. 

c.  Low  task  organisation  produced  lower  retention  only  for  low  levele 
of  training, 

d.  for  the  procedural  task,  only  ommlssive  errors  showed  relationehip 
to  level  of  training,  task  organization,  and  recentlon  Interval. 

3.  Cone lus lone 

a.  Amount  of  training  is  the  most  Important  variable  in  retention  of 
both  tracking  and  procedural  skills. 

b.  Absolute  level  of  skill  retained  is  related  to  taak  organisation 
principally  through  proficiency  level  attained  in  orlglrial  training,  but 
rate  of  loss  of  retention  (relative  to  original  performance  level)  is  not 
related  to  task  organizetlon, 

c.  gimilar  retention-decrement  effects  were  found  for  both  the  procsv 
dprel  end  tracking  fasks. 

4.  Comment 

These  reenlta  confirm  those  of  many  other  investigators  concerning  the 
greet  effect  pf  level  of  performance  on  retention.  The  failures  to  find 
that  task  organisation  gave  a consistent  main  effect  and  that  procedural 
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response  time  was  related  to  the  experimental  variables  were  surprising. 
While  these  results  are  not  directly  applicable  to  current  USAF  flight 
skill  retention  problems*  they  do  provide  a framework  for  predicting  or 
understanding  aspects  of  skill  retention  in  terms  of  relation  to  training* 
time*  and  task  organisation. 
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83.  Schrady,  D.A.  Activity  Levels  and  Aircraft  Types  In  Jet  Proflclancy 
Flying  (CRT)  at  NALF  Monterey~~Data  Acquisition  at  Pour  Houra  Par  Month 
In  tha  T-i A Airplane.  Report  NFS-SSisOOdsiA,  NaWl  Poatgraduat®  School • 
Monterey,  CA,  September  1970. 


1.  Summary 

Aa  a result  of  concern  by  the  Navy,  the  GAO,  and  the  Congreaa  over 
CRT  flying  requirements  for  pilots  in  student  status,  such  as  those  at 
the  Naval  Postgraduate  School  (NFS) , the  NPS  undertook  to  study  aspects 
of  CRT  in  1970.  The  concern  was  comparison  of  CRT  in  the  T<~1A  aircraft 
and  a leased,  business  jet  aircraft,  and  comparison  of  48-hours  per  year 
and  100-hours  per  year  CRT  groups.  This  report  describes  the  basic  data 
gathering  methods  and  instruments  that  were  to  be  used  in  the  study.  As 
such,  it  does  not  present  analyses  pertinent  to  CRT  or  to  long-term  re- 
tention questions.  It  does  present  the  semi-objective  inflight  check- 
list used  to  gather  performance  data.  Data  are  presented  dealing  with 
use  of  the  checklist  to  derive  flight  performance  scores.  It  is  des- 
cribed here  as  background  for  data  presented  in  Hanley's  i'1971  thesis 
in  which  inflight  performance  comparisons  are  made  for  the  two  CRT  level 
groups. 

2 . Comment 

1 

This  report  presents  no  data  pertinent  to  CRT  programs  or  to  long-term 
retention  of  skills.  It  is  significant,  however,  In  setting  forth  a method 
for  semi-objective  Inflight  performance  measurement  tp  be  used  In  more 
direct  studies  of  CRT  and  retention.  In  view  of  the  dearth  of  objective 
flight  performance  data  in  CRT  and  long-term  flight  skill  retention  stu- 
dies, it  is  a welcome  addition,  though  the  methodology  cannot  be  consid- 
ered fully  developed. 


1/ 

Hanley,  M.J.  Investigation  of  the  Effects  of  Increased  Flying  Hours  on 
Naval  Postgraduate  School  Aviator  Skill,  Knowledge,  and  Satisfaction;  A 
Comparative  Analysis.  Masters  Thesis.  Naval  Postgraduate  School,  Monterey, 
CA,  MaVch  1971. 
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85.  SeltEer,  L.Z.  A Study  of  the  Effect  of  Time  on  the  Instrument  Skill  of 
the  Private  and  Commercial  Pilot.  Report  No.  FAA-DS-70-12,  Department 

of  Transportation,  Federal  Aviation  Administration,  Washington,  DC,  April 
1970. 

86.  Also  published  In  revised  form  as:  Seltzer,  L.Z.  and  McBrayer,  J.D.  A 

Study  of  the  Effect  of  Time  on  the  Instrument  Skill  of  the  Private  and 
Commercial  Pilot.  Report  No.  FAA-DS-70-12.  Parks  College  of  Aeronautical 
technology  of  St.  Louis  University,  Cahokla,  XL,  March  1971. 


1.  Description 

Flight  performance  of  a sample  of  66  private  or  commercial  pilots  (none 
of  whom  was  Instrument  rated,  a former  military  pilot,  or  certificated 
prior  to  1960)  was  examined  to  assess  the  effect  of  time  on  their  instru'** 
ment  proficiency.  By  "time,"  the  author  is  referring  to  years  since  cet" 
tiflcatlon.  Flight  proficiency  was  evaluated  by  means  of  a subjective 
Instrument  checkrlde  in  which  various  elements  were  rated  on  a five-point 
scale.  For  those  elements  rated  "below  average"  or  "unsatisfactory,"  in- 
struction was  given  and  tliqe  noted.  Subsequently,  a seco  ' checkrlde  was 
given.  No  real  data  analyses  are  presented,  only  a few  dei.  . - tlve  plots 
and  tables. 

2.  Results 


Due  to  the  method  of  data  presentation  used  in  this  report.  It  Is 
difficult  to  Identify  specific  results.  However,  the  following  are  noted: 

a.  The  best  Instrument  flight  performance  by  private  pilots  was  on 
"straight  and  level"  and  "level  turns,"  while  they  were  poorest  on  "trim 
control,"  "power  control,"  and  "stall  and  spiral  recovery." 

b.  Commercial  pilots  did  well  on  level  flight  maneuvers  and  were 
weaker  on  climbing  and  descending  turns. 

c.  Private  pilot  performance  as  a function  of  time  since  certification 
seems  to  show  minor,  random  variation  about  the  so-called  "average"  score. 

d.  Commercial  pilot  performance  seems  to  show  a gradual  decline  from 

a level  somewhat  above  "average"  at  certification  to  an  as3nnptoLlc  "average" 
level  at  about  5.5  years  after  certification. 

3 I Conclusions 

From  the  results.  Seltzer  draws  the  following  conclusions: 

a.  "There  la  a definite  loss  of  instrument  proficiency  with  time  for 
the  private  pilot  and  to  a lesser  degree  for  the  commercial  pilot." 

b.  "This  loss  of  proficiency  is  attributed  partly  to  the  motor  skills 
of  the  Individual  pilot  and  also  to  his  lack  of  knowledge." 
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c.  "A  majority  of  pilots  did  not  seem  to  have  a thorough  understanding 
of  the  primary  Instrument  Indications  experienced  In  Straight  and  Level 
Flight,  Climbing,  and  Descending  Turns." 

d.  "The  time  required  to  regain  the  Instrument  proficiency  In  any 
case,  varied  with  the  pilot,  . . . For  the  private  pilots,  the  average 
time  to  regain  proficiency  was  2h  hours  of  flight  Instruction  and  SO 
minutes  of  ground  Instruction;  for  the  commercial  pilot.  It  was  l>i  hours 
of  flight  Instruction  and  25  minutes  ground  Instruction." 

4.  Comment 


This  study  adds  nothing  to  our  knowledge  of  flight  skill  retention. 

It  was  a very  poorly  conceived  and  executed  effort  and  was  not  designed 
to  examine  non-practice  as  an  Independent  variable.  Flight  performance 
measures  are  very  suspect,  and  it  is  virtually  Impossible  to  tell  Just 
what  was  done  or  to  evaluate  the  results  from  the  presentation  in  the 
report.  The  study  Is  reviewed  here  In  some  length  only  because  of  the 
great  discrepancy  between  the  seeming  pertinence  or  promise  of  the  title 
to  USAF  concerns,  on  the  one  hand,  and  the  actual  barrenness  of  the  re- 
port In  terns  of  content,  conclusions,  and  scientific  rigor. 

This  report  was  revised  and  republished  In  March  1971  under  the  same 
title  and  report  number,  but  with  James  D.  McBrayer  added  as  a second  author. 
The  revised  version  presents  a good  deal  more  In  the  way  of  data  analysis 
and  deletes  some  of  the  Interpretations  given  in  the  original  to  explain 
year-to-year  variations  In  certain  of  the  data.  The  revision  Is  an  Im- 
provement, but  the  basic  weaknesses  of  the  study  remain. 


Shaver t G.J.  Proficiency  Flying  In  the  USMO  An  Analyejn. 
Study.  Air  University,  Maxwell  AFB,  May  1971. 


Research 


Suifflary 

This  research  study  reviews  a variety  of  items  pertinent  to  USMC 
proficiency  flying.  No  new  primary  data  are  presented,  but  the  author 
presents  Navy  accident  data  for  CRT  and  non-CRT  aviators  during  their 
first  and  second  3-month  periods  of  Combat  Replacement  Air  Wing  (CRAW) 
training.  Accident  rates  per  10,000  hours  during  the  first  3-month 
period  were  0.883  and  1.269  for  the  CRT  and  non-CRT  groups,  respectively 
(jet  pilots  only;  rates  were  0.339  and  0.487  for  non-jet  groups).  During 
the  second  3-month  period  rates  dropped  to  0.620  and  0.63?  for  the  CRT 
and  non-CRT  jet  pilot  groups  (0.236  and  0.239  for  non-jet  groups).  While 
the  lower  accident  rpte  in  CRAW  training  would  seem  to  support  the  need 
for  CRT  flying,  the  author  correctly  notes  that  accidents  that  occurred 
during  CRT  flying  should  be  included  In  the  CRT  group  data  for  a meaning- 
ful comparison.  Shaver  questions  the  need  for  and  effectiveness  of  CRT 
programs  in  general  and  notes  that  no  definitive  data  exist  on  proficiency 
programs  because  "...  lack  of  a controlled  environment  seriously  degrades 
any  reliable  findings.  A controlled  study  should.be  undertaken."  He  ob- 
serves that  it  requires  about  550  hours  of  an  aviator's  time  (the  equiva- 
lent of  11  50-hour  work-weeks)  for  him  to  get  the  required  100  hours  per 
year  of  CRT,  time  that  could  better  be  devoted  to  his  primary  (i.e.,  non- 
flying) duties. 

2.  Comment 

This  is  a good  secondary  review  source.  The  author  has  examined  the 
subject  fairly  thoroughly.  While  he  does  not  treat  the  subject  of  long- 
term retention  of  flight  skills,  he  seems  of  the  opinion  that  retention 
would  not  be  a problem  in  a program  of  no-CRT  followed  by  retraining,  and 
that  such  a program  would  be  cost  effective. 
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88.  Sltterley,  T.E.  Degradation  of  Learned  Skills  ■—  Static  Practice 
Effectivenesa  for  Visual  Approach  and  Landing  Skill  Retention.  Boeing 
Document  D180-17876-1,  The  Boeing  Aerospace  Company,  May  1974. 

89.  Sltterley,  T.E.  and  Berge,  W.A.  Degradation  of  Learned  Skills  — 
Effectiveness  of  Practice  Methods  on  Simulated  Space  Flight  Skill 
Retention.  Boeing  Document  D180-15081-1,  The  Boeing  Company,  July 
1972. 

90.  Sltterley,  T.E. , Zaitzeff,  L.P.,  and  Berge,  W.A.  Degradation  of 
Learned  Skills  — Effectiveness  of  Practice  Methods  on  Visual  Approach 
and  Landing  Skill  Retention.  Boeing  Document  D180-15082-1,  The  Boeing 
Company,  October  1972. 


Description 

The  purpose  of  this  series  of  three  related  studies  was  to  examine 
long-term  retention  of  skills  In  the  flying  of  manned  spacecraft.  All 
three  studies  Involved  simulated  spacecraft  relevant  to  the  NASA  manned 
spaceflight  program.  In  the  first  study,  the  task  Involved  manual  control 
of  the  simulated  spacecraft  from  lift-off  to  orbit  insertion.  Retention 
of  procedural  and  control  skills  was  examined  for  intervals  ranging  from 
one  to  six  months.  Nine  groups  of  five  subjects  each  (predominantly  non- 
pilots) allowed  study  of  several  methods  of  retraining.  The  last  two 
studies  Involved  the  simulated  descent,  approach,  and  runway  landing  of 
the  spacecraft  after  assumed  de-orbit  and  reentry.  Both  instrument  and 
far-fleld  visual  cues  were  presented.  All  subjects  were  former  pilots. 

Four  groups  of  five  subjects  each  were  used  to  study  effects  of  retraining 
methods.  These  studies,  sponsored  by  NASA,  utilized  a complex  task  with 
a fairly  wide  variety  of  stimulus  characteristics  and  response  demands. 
Methods  of  retraining  in  the  first  study  were  (a)  dynamic  warmup  (hands-on), 
(b)  distributed  rehearsal  (static,  non-hands  on),  and  (c)  Immediate  re- 
hearsal (static,  non-hands  on).  Methods  in  the  second  study  were  (a) 
static  rehearsal  (non-hands  on)  and  (b)  dynamic  display  rehearsal  (non- 
hands on),  while  the  third  study  utilized  an  Improved  static  retraining 
method  (non-hands  on)  that  Involved  heavy  emphasis  on  outside  visual  cues. 

2.  Results 


a.  Degradation  of  continuous  control  skill  was  moderate  for  the  first 
three  months,  but  Increased  sharply  at  that  point,  with  magnitude  of  error 
for  most  control  parameters  exceeding  end-of-training  levels  by  a factor 
of  two  to  three. 

b.  Procedural  tasks  showed  strong  degradation  in  tlme-to-execute 
after  only  one  month  of  no  practice  (five  times  end-of-training  value) , 
and  then  showed  a further  sharp  degradation  after  the  third  month  (reach- 
ing 17  times  end-of-tralning  value  after  four  months). 

c.  Relative  skill  degradation  was  found  to  be  greater  for  instrument 
flight  skills  than  for  those  involving  far-fleld  visual  cue  referents, 
though  this  finding  was  not  subjected  to  statistical  test,  nor  was  task 
loading  equated  for  the  two  types  of  task  situations. 
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d.  Rehearsal  practice  distributed  throughout  the  retention  Inter- 
val  was  more  beneficial  than  only  Immediate  rehearsal  just  prior  to 
retraining. 

e.  Rehearsal  (distributed)  was  sufficient  to  maintain  procedural 
skills  at  near-original  learning  performance  levels  for  up  to  six  months. 

f.  In  retraining  after  four  months,  the  static  rehearsal  method  was 
found  least  effective,  dynamic  display  next,  and  the  Improved  static  re- 
training method  (which  emphasized  visual  cues)  was  found  most  effective. 
The  latter  method  maintained  skills  at  Initial  training  levels  with  no 
decrement,  essentially,  after  the  four  month  period. 

g.  Far-fleld  visual  cues  are  Important  in  maintaining  skills,  but 
their  representation  in  static  form  was  as  effective  as  when  they  were 
represented  dynamically. 

3.  Conclusions 


a.  Significant  performance  decrements  occur  in  both  procedural  and 
continuous  control  skills  unless  some  form  of  practice  or  rehearsal  Is 
interspersed  during  the  retention  Interval,  with  the  effect  being  rela- 
tively greater  for  procedural  tasks. 

b.  ^oth  procedural  and  control  task  skills  can  be  maintained  at  rela- 
tively high  levels  with  fairly  simple,  static  rehearsal  techniques. 

4 . Comment 


This  series  of  well-designed  and  executed  studies  utilized  a task  of 
complexity  and  content  similar  to  that  of  the  USAF  pilot.  The  data  show 
that  significant  degradations  in  skills  do  occur  in  the  absence  of  prac- 
tice, but  the  highly  favorable  results  with  static  rehearsal  techniques 
suggest  that  USAF  pilots  might  maintain  flight  skills  at  relatively  high 
levels  during  non-flying  periods  through  use  of  such  procedures.  The  use 
of  such  techniques  in  conjunction  with  the  use  of  flight  simulators  or 
other  devices  should  allow  significant  reductions  in  retraining  costs 
and  is  an  area  well  worth  exploration. 


91.  Smith,  J.F. , and  Matheny,  W.G.  Continuation  Vereue  Racurrant  Pilot 

Training.  AFHRL-TR-76-4,  Air  Force  Human  Resources  Laboratory,  Brooks 
AFB,  TX,  May  1976. 


1.  Summary 

In  response  to  current  USAF  concern  over  continuation  (l.e.,  proficiency) 
training  programs,  the  availability  of  resources  to  support  such  programs, 
and  the  readiness  of  the  rated  supplement  for^e,  the  Human  Resources  Labo- 
ratory conducted  a survey  of  the  literature  on  pilot  skill  retention  and 
developed  pertinent  conclusions  from  that  literature. 


Some  15  references  are  reviewed  briefly  In  the  report.  In  addition, 
six  bibliographic  Items  are  listed,  though  these  are  not  reviewed.  Of 
considerable  Interest  Is  the  authors'  inclusion  of  data  and  discussion  of 
unpublished  material  1.' dealing  with  the  retraining  of  returned  USAF  POWs 
from  Southeast  Asia.  These  POW  returnees  had  from  300  to  over  7,000  hours 
of  total  flight  time  before  being  shot  down,  and  time  as  POW  varied  from 
13  to  102  months.  These  pilots  were  retrained  by  the  Air  Force  In  a highly 
Individualized  training  effort  to  bring  these  pilots  back  up  to  required 
proficiency  levels.  All  training  took  place  at  a single  location. 


Due  to  the  period  of  cessation  of  bombing  of  North  Vietnam  during  the 
conflict,  two  distinct  groups  of  POWs  resulted.  Data  are  presented  for  two 
groups:  (1)  those  whose  non-flying  episode  ranged  from  13  to  34  months 

(M  “ 19  months) ; and  (2)  those  whose  non-flying  period  ranged  from  69  to 
102  months  (M  - 84  months).  Retraining  flight  time  for  the  21  pilots  in- 
cluded In  the  shorter  episode  group  averaged  38.4  hours,  while  average  time 
for  the  39  pilots  In  the  longer  episode  group  averaged  45.4  hours.  Average 
retraining  time  for  all  returnees  was  42.2  hours.  Grouping  the  pilots  into 
three  categories  on  the  basis  of  total  flight  time  (Low  » 300-1,000  hours; 
Mid  » 1,001  - 2,000  hrs.  ; and  High  «■  2,001  - 7,250  hrs.)  resulted  In  statis- 
tically significant  differences  in  retraining  time  between  the  low-time 
group  and  the  other  two  groups.  Mean  retraining  flight  hours  were  48.5, 
35.3,  and  41.6  for  the  Low,  Mid,  and  High  groups,  respectively. 


— No  formal  publication  dealing  specifically  with  POW  pilot  retraining  is 
known  to  the  present  author.  However,  another  exposition  based  on  the  POW 
retraining  data,  one  somewhat  more  extensive  than  that  of  Smith  and  Matheny, 
is  contained  in:  Armstrong,  M.B.,  Bleymaier,  J.S.,  Hlnkel,  J.F.,  Levins,  R., 

and  Sheppard,  R.R.  Flying  Skill  Retention  and  Proficiency  Flying.  Research 
Study  Report  No.  0095-75,  Air  Command  and  Staff  College,  Air  University, 
Maxwell  AFB,  AL,  May  1975. 
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Based  on  the  studies  reviewed  and  the  POtf  retraining  data,  the  authors 
identify  the  following  ae  significant  findings: 

(a)  Motor  skills  associated  with  VFR  flight  are  retained  longer  and 
regained  much  more  quickly  than  Instrument  or  procedural  and  verbal  skills.  '• 

(b)  Inactivity  for  one  year  results  in  near  maximum  loss  of  skills 
(one  estimate  is  90  percent),  and  subsequent  periods  of  inactivity  add 
little  to  average  upgrade  time  requirements. 

(c)  If  Instrument  flight  skills  are  maintained  at  a high  level,  contact 
flight  skills  tend  to  remain  at  an  acceptable  level. 

(d)  Overlearning  promoted  Improved  retention  of  all  categories  of  skills 

(e)  Simulators  are  effective  in  either  learning  or  relearning  proceo 
dural  and  verbal  tasks  and  instrument  flying  skills,  and  their  use  should 
significantly  reduce  the  hours  noted  in  paragraph  (f),  following. 

(f)  Retraining  of  contact  and  Instrument  aircraft  flight  skills  after 
extended  periods  of  inactivity  (13  to  102  months)  can  be  completed  in  an 
average  of  45  aircraft  hours  or  less  per  student. 

(g)  Pilots  of  low  experience  levels  (less  than  1,000  hours)  will  re- 
quire more  hours  to  become  recurrent, but  the  overall  average  should  remain 
below  50  hours  per  pilot. 

Based  on  these  findings  the  authors  conclude  that  abolition  of  con- 
tinuation training  could  result  in  significant  cost  savings  to  USAF,  and 
that  recurrent  training  could  be  delayed  almost  indefinitely  until  required 
by  new  Job  assignment  or  other  USAF  needs. 

2.  Comment 


While  the  authors  describe  their  review  as  of  limited  nature,  they  have 
touched  on  the  more  significant  available  documents.  The  provision  of  the 
POW  retraining  data  is  a valuable  addition  to  the  literature.  The  depth 
with  which  the  various  studies  are  reviewed  in  the  Smith-Matheny  report  is 
minimal  (l.e.,  the  amount  of  detail  in  their  written  discussion),  but  their 
conclusions  seem  well-warranted  by  the  present  author's  review  of  the  lit- 
erature. However,  as  Smith  apd  Matheny  note,  available  data  are  meager, 
and  more  data  are  needed  to  permit  informed  USAF  policy. 
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92.  S»lttl«,  J.H.  "Current**  va.  **Sta8nant”  Jot  Pilots*  Reaponta  Tlmgi  A 
CoMparleon.  Mastere  Thesis.  U.  S.  Naval  Postgraduate  School,  Monterey, 

caTiSHT’ 


1.  Summary 

This  study  compared  control  response  times  of  aviators  who  had  flown 
within  the  last  60  days  with  those  of  aviators  who  had  not  flown  within 
60  days.  The  stimulus  was  tachlstoscopic  exposure  of  slides  of  the  ver- 
tical gyro  Indicator  depleting  unusual  aircraft  attitudes.  Results  showed 
no  significant  differences  between  current  and  stagnant  groups.  Pilots 
with  1,700  hours  or  more  had  significantly  faster  reactions  than  those 
with  less  time. 

2.  Comment 


This  study  is  of  little  value  to  the  retention  question.  Methodology 
was  weak. 


102.  Tice,  R.K.  Navigator  Proficiency  Flying.  Research  Study.  Air  University, 
Maxwell  AFB,  May  1973. 


1.  Summary 

The  focus  of  this  study  was  navigator  proficiency  flying,  rather  than 
pilot  programs.  No  new  data  are  presented,  but  a number  of  studies  are 
reviewed  as  the  author  develops  his  general  thesis  that  USAF  proficiency 
programs  for  navigators  in  the  rated  supplement  are  not  effective,  not  re- 
quired, and  unduly  costly.  He  cites  data  on  the  retraining  of  31  B-58 
Defensive  Systems  Operators  as  Navigators  at  the  KC-135  navigation  CCTS. 
Only  one  of  this  group  had  ever  flown  as  a navigator  after  being  rated, 
all  having  been  EW  specialists.  Failure  rate  in  the  navigator  CCTS  pro- 
gram for  the  group  was  only  6.7%  versus  ISZ  for  regular  navigator  students 
in  the  program.  The  author  concludes  that  there  had  been  no  decline  in 
the  group’s  navigator  skills  during  their  extended  period  as  EW  special- 
ists. 

2,  Comment 


While  this  study  does  not  deal  directly  with  pilot  skills,  there  Is 
such  commonality  between  pilot  and  navigator  tasks  that  the  author's  re- 
view has  some  pertinence.  Obviously,  It  can  be  argued  that  the  B-58  EW 
people  had  been  flying  and  performing  jobs  that  had  much  in  common  with 
navigator  requirements.  However,  this  suggests  that  transfer  from  one 
job  or  task  to  another  can  maintain  certain  skills  over  extended  periods 
and  that  non-flying  skill  maintenance  alternatives  (e.g.,  use  of  simula- 
tors) may  be  sufficient  during  extended  periods  of  non-flying  duty. 


107.  United  States  Air  Force.  A Study  of  Pilot  Proficiency  Flying  (Saber  Wings) . 
Volumes  I and  II.  Assistant  Chief  of  Staff,  Studies  and  Analysis,  Hq., 

USAF,  Washington,  DC,  1969.  (FOR  OFFICIAl.  USE  ONLY).  , 


1.  Summary 

This  effort  examined  USAF  proficiency  flying  programs  and  examined 
alternative  programs  for  maintaining  proficiency.  While  the  reports  are 
FOR  OFFICIAL  USE  ONLY,  only  open  end  unclassified  portions  will  be  dis- 
cussed here.  CCTS  training  data  were  used  to  examine  relationships  of 
variables  such  as  age  and  flying  experience  to  CCTS  training  performance. 
In  addition,  some  10,400  'pHots  were  surveyed  concerning  their  opinions 
and  experience  relevant  to  proficiency  flying  programs.  While  the  study 
did  not  address  the  area  of  flight  skill  retention  experimentally.  It  did 
Indicate  that  age  was  a significant  factor  In  CCTS  performance  In  some 
situations,  and  Chat  slmillarlty  of  aircraft  background  to  tliat  of  CCTS 
training  (a.g.,  fighter-fighter,  or  airlift-airlift)  was  also  a signifi- 
cant factor.  Pilot  opinion,  nor  surprisingly,  favored  proficiency  pro- 
grams Involving  more  hours  and  combat-type  aircraft. 

2 . Comment 


This  was  an  extensive  effort  by  the  Air  Force,  one  that  has  Influenced 
the  thinking  of  many  persons  about  proficiency  flying.  In  consonance  with 
the  general  orientation  of  the  Air  Force  at  the  time  of  the  study,  the  study 
leans  toward  Improving  proficiency  programs  within  the  same  general  struc- 
ture. Certain  of  the  data  addressed  (e.g.,  relationship  of  age  to  CCTS  per- 
formance) are  Interesting  and  should  be  Investigated  further.  The  validity 
of  CCTS  grade  data  for  determinations  related  to  skill  retention  Is  unknown 
and  should  be  Investigated.  The  pilot  opinion  data  must  be  examined  care- 
fully In  light  of  the  sltuatlpn  that  existed  at  the  time  of  the  study  (i.e. , 
fuel,  dollar,  and  resource  availability)  before  being  generalized  for  appli- 
cability to  other  times  and  circumstances.  Saber  Wings  was  an  ambitious 
effort  which  has  elicited  both  emotion  and  serious  thought  with  reference  to 
USAF  proficiency  flying  requirements. 
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114.  Wilson,  W.8.  The  Effect  of  Prolonged  Non-Flyltipj  Periods  on  Pilot  Skill 

In  Performance  of  a Simulated  Carrier  Landing  Task.  Masters  Thesis.  Naval 
Postgraduate  School,  Monterey,  CA,  September  1973. 


1.  Description 

The  effects  of  flight  currency  and  experience  on  perfonisance  of  a 
simulated  carrier  landing  task  were  examined  In  this  study.  Fifteen 
aviators  were  divided  Into  three  currency  groups:  (a)  current  (i.e., 

flown  within  past  60  days) ; (b)  one-year  stagnant  (10-17  months  no-fly) j 
and  (c)  two-years  stagnant  (25-30  months  no-fly).  Subjects  were  also 
classified  Into  three  experience  groups:  (a)  low  (<500  hours);  (b)  inter- 

mediate (1100-1400  hours) ; and  (c)  high  (>1900  hours) . The  task  was  a 
simulated  carrier  landing  Involving  a minimal  aircraft  simulation  and  a 
computer  image  visual  display  of  the  carrier.  Performance  score  was 
based  on  point  of  touchdown,  rate  of  descent  at  touchdown,  lateral  error, 
and  airspeed. 

2.  Results 


(a)  No  significant  difference  as  a function  of  currency. 

(b)  Such  degradation  as  occurred  over  time  was  procedural,  not 
tracking  skills. 

(c)  The  Low  Experience  group  performed  significantly  lass  well 
(p<.10)  than  did  the  other  two  groups. 

3.  Conclusions 

(a)  Tracking  skills  remain  Intact  over  long  periods  of  no  flying. 
Degradation  is  largely  in  procedures. 

(b)  Experience  does  Influence  tracking  skill.  Therefore,  the  RAG 
training  syllabus  should  be, individualized  on  the  basis  of  experience. 

4 . Comnient 


This  is  a good  effort  under  the  circumstances  (i.e.,  as  a Masters 
thesis  with  limited  resources),  but  it  is  restricted  on  several  grounds. 
The  simulated  task  was  not  complex,  and  its  represe.itativeness  of  opera- 
tional flying  can  be  questioned.  However,  the  experimental  design  and 
data  analysis  techniques  were  appropriate.  All  in  all,  the  data  and 
results  are  judged  as  pertinent  to  current  USAF  skill  retention  problems. 
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Wrlghc,  R.H.  Retention  of  Flying  Skjllli  and  R»frtth»r  Training  Raqulrt- 
aenta;  Effects  of  Nont lying  and  Proficiency  Flying.  HuaRRO  Technical 
Report  73-32,  Human  Resources  Research  Organisation,  Alexandria,  VA,  De- 
cember 1973. 


1,  Description 

The  objectives  o£  this  study  were  to  develop  data  concerning  the 
effects  of  non-flying  periods  on  aviator  skill  retention,  to  assess  the 
effectiveness  of  Army  proficiency  flying  programs,  and  to  develop  im- 
plications for  future  proficiency  maintenance  or  retraining  programs. 
Survey  forms  were  sent  to  some  5,500  Army  aviators  concerning  their  ex- 
periences relative  to  retention  of  flight  skills  during  non-flying  or 
"minlmums-only"  episodes  of  six  months  or  longer  and  their  retraining 
experiences  after  such  episodes.  Some  525  returns  were  received,  of 
which  data  analyses  were  performed  on  117  in  the  "mlnimums-only"  cate- 
gory and  58  in  the  "no-f lying"  category.  Respondents  were  asked  to  rate 
their  flying  ability  on  some  20  specific  aspects  or  components  of  flying 
skill  at  three  points  in  time  — when  first  rated,  just  before  the  no- 
flying  or  minlmums-only  episode,  and  just  after  the  episode.  An  11-polnt 
anchored  rating  scale  was  used  in  these  ratings.  In  addition  to  providing 
data  concerning  training  actually  received  after  such  episodes  in  prepara- 
tion for  return  to  flying  duties,  respondents  were  asked  to  provide  esti- 
mates of  time  required  to  regain  ability  level  at  first  rating  and  ability 
level  for  pllot-ln-coomand  duties. 

2.  Results 


a.  Flying  minimums  resulted  in  only  a slightly  lower  rate  and  amount 
of  '.OSS  of  flying  skill  than  did  not  flying  at  all. 

b.  About  90%  of  the  loss  in  flying  skill  that  occurs  over  extended 
periods  of  no-flying  or  minimums  occurs  within  the  first  12  months. 

c.  Respondents  indicated  higher  pre-episode  skills  in  visual  (VFR) 
than  in  instrument  (IFR)  flying,  but  rate  and  amount  of  decline  in  skill 
was  about  the  same  for  VFR  and  IFR  skills. 

d.  While  most  respondents  indicated  VFR  skills  remained  well  above 
minimum  acceptable  levels  for  no-flying  or  minimums  episodes  up  to  36 
months  in  length,  for  IFR  skills  approximately  half  reported  being  below 
mlDini;»m  acceptable  level  within  12  months  of  no-flying  or  minimums. 

e.  The  eff  ' of  proficiency  flying  on  retraining  requirements  was 
small  — a difference  of  only  2 hours  in  training  actually  received  by 
the  "mlnimums-only"  and  "no-flying"  groups,  and  a difference  of  estimated 
training  required  to  assume  pilot-in-command  duties  of  only  7 hours  for 
the  two  groups. 

f.  Those  who  flew  minimums  in  light  proficiency  aircraft  reported 
receiving  an  average  of  1,2  hours  more  retraining  instruction  after  the 
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«pl80de  than  did  those  who  did  no  flying  at  all,  while  proficiency  flying 
In  operational  aircraft  reduced  retraining  hours  repelved  by  1.4  hours, 
as  compared  with  no  flying. 

g.  Pilots  of  moderate  experience  levels  (500  - 2,000  hours)  reported 
receiving  about  3 hours  more  retraining  Instruction  after  an  episode  than 
did  those  of  lesser  or  greater  amounts  of  experience. 

3'  Conclusions 


a.  Large  losses  In  flight  skill  occur  over  time  whether  or  not  pro- 
ficiency flying  Is  performed. 

b.  VFR  skills  generally  remain  acceptable  for  up  to  3 years,  but 
IFR  skills  may  become  unacceptable  In  only  one  year. 

c.  IFR  skills  should  receive  primary  attention  In  proficiency  flying 
and  retraining  programs. 

d.  Performance  decrement  curves  for  flying  skills  are  similar  to  those 
for  other  skills,  with  most  decrement  occurring  within  the  first  year  and 
little  further  decrement  after  that  point. 

e.  Refresher  training  given  more  than  six  months  prior  to  resuming 
operational  flying  duties  will  have  little  value. 

f.  Proficiency  flying  or  refresher  training  in  aircraft  dissimilar 

to  operational  aircraft  may  result  In  habit  interference  and  negative  trans- 
fer. 


g.  Various  simulators  and  training  devices  would  seem  to  offer  the  most 
coat  effective  means  of  maintaining  proficiency  during  non-flying  episodes. 

4 . Comment 


This  study  is  probably  the  most  extensive  and  comprehensive  examination 
of  the  effects  of  no-flying  or  minimum  flying  episodes  on  the  skills  of  a 
military  pilot  population  to  date.  It  has  '-aisad  serious  questions  about 
the  effectiveness  of  proficiency  flying  programs,  specifically,  and  even 
about  the  requirement  for  such  programs,  generally.  This  latter  observa- 
tion stems  from  the  very  small  magnitude  of  difference  in  actual  retraining 
reported  by  no-fly  and  proflclency-fly  groups,  and  the  small  difference  in 
the  amount  of  retraining  perceived  as  needed  by  these  two  groups. 

This  study  suffers  in  two  areas  that  characterize  most  of  the  extant 
attempts  to  study  flight  skill  retention.  First,  the  data  are  not  actual 
objective  measures  of  inflight  performance,  being,  rather,  self-estimates 
of  proficiency  as  recalled  by  the  pilot.  The  cost  and  administrative  diffi- 
culty of  securing  actual,  soutid  inflight  proficiency  measures  before  and 
after  episodes  of  meaningful  length  have  plagued  most  investigators.  The 
second  problem  Is  that  of  securing  enough  subjects  to  obtain  adequate  size 
samples  to  cover  variables  of  interest  such  as  flight  experience,  age, 
alrcraft/mlasion  factors,  length  of  episode,  pre-episode  skill  level,  and 
the  like. 
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Ntvcrthtless , Wright  has  provided  data  of  Interest.  The  data  are 
generally  consonant  with  the  academic  literature  and  have  specific  action 
implications  within  the  Army  context.  However,  it  must  be  recognised  that 
USAF  flight  skill  retention  problems  have  many  facets  that  differ  from  those 
of  the  Wright  study.  While  it  is  likely  that  the  general  implications  of 
this  study  are  quite  applicable  to  USAF  concerns,  it  is  clear  that  the  spe- 
cifics cannot  be  explicated  to  the  USAF  situation  in  terms  such  as  hours 
of  retraining  required.  The  study  does,  though,  suggest  that  extended  no- 
flying episodes  followed  by  appropriate  retraining  activities  can  return 
pilots  to  the  cockpit  who  will  be  effective. 


I 'X'wir^UCTTsn^.,, 


117.  Youngling,  E.W.,  Sharpe,  E.N,,  Rickation,  B.8.,  and  McGee,  D.W.  Crew 
Skill  Retention  for  Space  Mlaslona  up  to  200  Daya.  McDonnell* Douglas 
Aatronautlca  Company,  Eastern  Division,  Rejport  F^66,  Dacember  1968, 


1.  Description 

As  part  of  studies  of  long  term  apace  missions,  effects  of  level  of 
training,  cloud  cover,  target  motion  difficulty  level,  and  retention  ln-< 
terval  on  performance  of  an  Image  motion  compensation  task  were  examined. 
Retention  Intervals  were  30,  90,  and  200  days.  Half  the  96  Ss  (male  com- 
pany engineering  and  computer  personnel)  received  60  Initial  training 
trials,  and  the  other  half  received  120  trials.  After  the  retention  inter- 
val, each  S received  25  trials  to  allow  evaluation  of  both  retention  and 
reacqulsltlon  performance. 

2.  Results 


a.  Amount  of  original  training  was  a significant  factor  In  amount  of 
performance  loss.  The  60  trial  group  lost  an  average  of  5.46  seconds  tlme- 
on-target  as  compared  with  only  2.41  seconds  for  the  120  trial  group.  How- 
ever, no  main  effect  was  shown  on  reacqulsltlon  time. 

b.  A linear  relationship  between  length  of  retention  Interval  and 
amount  of  performance  loss  was  found.  Loss  was  1.33  seconds  for  the  30-day 
Interval,  3,28  seconds  for  the  90-day  Interval,  and  7.19  seconds  for  the 
200-day  interval.  Retention  interval  had  similar  effect  on  both  levels  of 
training,  with  losses  of  the  60-trial  group  being  approximately  twice  as 
great  as  those  of  the  120-trial  group  at  each  retention  interval.  Length 
of  retention  interval  had  an  effect  on  skill  reacqulsltlon  time  with  the 
200-day  group  requiring  significantly  more  retraining  than  the  other  two 
groups  who  did  not  differ  from  one  another. 

c.  Atmospheric  degradation  did  not  affect  retention  or  reacqulsltlon 
as  a main  effect,  but  did  Interact  with  other  variables. 

d.  Performance  loss  was  found  to  vary  Inversely  with  target  motion 
difficulty,  l.e.,  performance  under  the  more  difficult  motion  condition 
showed  less  decrement  over  time  than  under  the  less  difficult  task  condi- 
tion. No  difference  was  found  In  reacqulsltlon  times  for  the  various 
difficulty  levels. 

3.  Conclusions 

a.  Retention  Increases  as  a function  of  amount  of  original  training. 

b.  Retention  decreases  linearly  as  a function  of  length  of  no-practlce 
interval. 

c.  in  this  task  many  of  the  interactions  among  the  independent  variables 

were  leant . 
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4.  Comment 

The  rather  restricted  nature  of  the  task  studied  here  makes  these 
results  of  minimal  direct  use  In  the  understanding  of  USAF  pilot  skill 
retention  problems.  The  study  was  well  designed  and  executed 
quite  pertinent  to  space  flight  concerns.  The  finding  that  more  diffi- 
cult skills  were  better  retained  was  unexpected,  but  the  authors  state 
that  It  ”.  . • may  easily  he  an  artifact  of  the  difficulty  level  meas- 
urements . " 
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11.  Bcckar,  T.T.  Proficiency  Flying.  Thesis,  Air  War  College,  Maxwell  APB,  AL, 
June  1965. 


The  author  reviews  USAF  proficiency  flying  programs  and  concludes  It 
is  an  Inappropriate  and  costly  form  of  incentive  pay.  He  recommends  a 
revised  manpower  program  that  recognizes  a less  than  full  career  as  a rated 
officer. 


23.  Buckout,  R. , Naylor,  J.C.,  and  Briggs,  G.E.  Effects  of  Modified  Task 

Feedback  during  Training  on  Performance  of  a Simulated  Attitude  Control 
Task  after  30  Days.  Technical  Documentary  Report,  AMRL-TDR-63-125,  Aero- 
space Medical  Research  Laboratories,  Wrlght-Patterson  AFB,  OH,  1963. 


Retention  over  a 30-day  period  was  shown  to  be  enhanced  by  higher 
levels  of  Initial  training.  Effects  of  visual  and  auditory  noise  were 
also  examined. 


31.  Fullmer,  W.M.  Impact  of  Pilot  Flight  Excusal  Program  on  Indirect  Mission 
Support  Flying.  Professional  Study  No.  4927,  Air  War  College,  Maxwell  AFB, 
AL,  April  1973. 


The  author  reviews  USAF  proficiency  flying  programs  and  recommends  more 
efficient  use  of  indirect  mission  support  flying.  No  data  are  presented, 
and  the  report  does  not  add  to  our  Information  concerning  long-term  reten- 
tion. 


36.  Girling,  W.D.  Proficiency  Flying;  An  Analysis.  Research  Report,  Air 
Command  and  Staff  College,  Air  University,  Maxwell  AFB,  AL,  May  1965. 


Proficiency  flying  Is  reviewed  in  terms  of  Its  history  and  utility. 
The  author  concludes  it  is  inappropriate,  costly,  and  detracts  from 
performance  of  staff  officers  In  non-flying  jobs. 
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Grodsky,  M.A.  and  Lutman,  C.C.  "Pilot  Reliability  and  Skill  Retention 
for  Spaceflight  Missions."  Air  University  Review.  May-June  1965*  22-32. 


This  article  presents  a preliminary  report  of  a Joint  MASA/USAP  study 
of  long-term  retention  of  spaceflight  pilot  skills  required  for  lunar  land- 
ing missions.  A detailed  report  ol  this  effort  Is  given  by  Cotterman  and 
Wood  In  their  1967  report.  U 

— Cotterman,  T.E.  and  Wood,  H.E.  Retention  of  Simulated  Lunar  Landing 
Mission  Skill;  A Test  of  Pilot  Reliability.  Technical  Report  No.  AMRL- 
TDR-66-222,  Aerospace  Medical  Research  Laboratories,  Wrlght-Patterson  AFB, 
OH,  April  1967. 


Hansen,  A.G.  Analysis  of  Pilot  Proficiency  and  Excusal  Programs.  Pro- 
fessional Study  No.  4601,  Air  War  College,  Maxwell  AFB,  AL,  April  1972. 


The  author  reviews  the  history  of  proficiency  flying  programs,  relates 
them  to  the  manpower  requirements  of  TOPLINE,  and  concludes  that  profi- 
ciency flying  programs  are  not  effective.  This  Is  an  analytical  study 
and  adds  no  new  data  or  Information  concerning  long-term  retention  of 
flight  skills. 


Jakubczak,  D.R.  Proficiency  Flying  for  Rated  Supplement  Navigators;  A 
Necessity?  Research  Study,  Air  University,  Maxwell  AFB,  AL,  May  1973. 


Navigator  proficiency  flying  programs  are  critically  examined,  and 
the  author  says  the  proficiency  program  for  navigators  is  a waste  of  time 
and  money  ($6.2M/yr.;  N*500) . 
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97.  Snow,  J.H.  An  Analysis  of  the  USAF  Proficiency  Plying  Program.  Thesis, 
Air  Commend  and  Staff  College,  Air  University,  Maxwell  AFB>  AL,  June  1965. 


The  author  looks  at  mission  support  aircraft  used  for  proficiency 
flying.  He  concludes  that  the  T-33  and  T~39  have  only  limited  mission 
1 support  potential,  and  that  USAF  needs  a new  light  transport  aircraft 

I to  replace  the  C~A7  as  a mission  support,  proficiency  aircraft. 

i ' i 


110.  Wellington,  R.  Proficiency  Flyings  Outlook  for  the  1970s.  Professional 
Study  No.  4749,  Air  War  College,  Maxwell  AFB,  AL,  April  1972. 


This  document  gives  a good  history  of  USAF  proficiency  flying  from 
1913  to  1971.  For  example,  the  Baker  Board  (1934)  set  100  hours  per 
year  as  minimum;  the  Hook  Commission  (1948)  discussed  "hazard  pay;"  Con- 
gress.  In  the  Defense  Appropriations  Act  for  FY  1952  (PL  179),  stated 
"no  fly,  no  flight  pay;"  the  Strauss  Commission  (Sept  1952)  established 
the  Central  Flight  Status  Selection  Board  to  screen  continuance  on  flying; 
etc.  The  author  reviews  the  PRC  Proficiency  Flying  Study  (1967);  Saber 
Wings  (1969) ; and  the  LTV  CRT  Study  (1968).  Based  on  these  and  a variety 
of  other  sources,  the  author  concludes:  (a)  Aircraft  operating  costs, 

not  flight  pay,  are  the  Issue  now  with  Congress;  (b)  Congress  dislikes 
large  numbers  of  senior  officers  in  proficiency  flying  status;  (c)  Fear 
of  loss  of  middle  and  upper  level  Input  Is  the  dominant  factor  In  flight 
Input  policies;  and  (d)  There  is  no  measure  of  effectiveness  of  USAF 
proficiency  flying,  and  USAF  defense  of  the  program  to  Congress  is  weak. 
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IV.  NON-FLIGHT  SKILL  RETENTION  STUDIES 

A nunbcr  of  gtudlco  were  identified  that  deal  with  the  subject  of 
skill  retention,  but  in  a non-flight  setting.  Many  of  these  deal  with 
notor  skills  or  procedural  skills  that  are  conceptually  related  to  flight 
tasks  and  have  been  selected  for  inclusion  in  this  section.  Studies  of 
verbal  skill  retention  have  not  been  covered  for  reasons  previously  cited. 

Many  of  the  efforts  reported  In  this  section  deal  with  general  skills 
(e.g.,  tracking)  that  are  obviously  pertinent  to  flying,  or  with  the  re- 
tention of  procedural  task  skills.  While  the  decisions  for  Inclusion  of 

I 

a given  study  In  Section  III  or  Section  IV  were  a bit  arbitrary  at  times, 
both  sections  deal  with  retention  studies  and  are,  therefore,  of  Interest 
with  reference  to  USAF  concern  over  long-term  pilot  skill  retention. 
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Gardlln»  G.R^  Judgment  of  Skill  Retention.  Doctoral  Dissertation,  Uni- 
versity of  Washington,  ISH.  (University  Microf llns) . 


1.  Swnmary 

Sixty  male  subjects  learned  a perceptual-motor  task  (two-hand  control 
of  rolling  a marble  through  a maze)  to  a high  skill  level.  After  inter- 
vals of  1,  3,  or  b weeks,  subjects  gave  self-estimates  of  residual  per- 
formance level  and  number  of  trials  that  would  be  required  to  reach  former 
performance  levels.  Results  indicated  subjects  gave  inflated  Judgments 
of  their  own  skill  levels  after  the  retention  interval  and  that  they  were 
Insensitive  to  the  amount  of  retraining  required  to  regain  proficiency. 

2.  Comment 


While  the  task,  subject  population,  and  retention  intervals  used  are 
quite  different  from  those  of  concern  to  USAF  with  reference  to  long-term 
flying  skill  retention,  these  results  raise  questions  about  the  use  of 
self-estimates  of  residual  proficiency,  amount  of  skill  decrement,  or 
amount  of  training  required  to  regain  proficiency  In  studies  of  flight 
skill  retention.  Because  of  the  difficulty  of  collecting  actual  Inflight 
measures  of  flying  proficiency  after  no-flying  periods,  many  flying  skill 
retention  studies  have  been  forced  to  use  such  self-estimates.  While  the 
present  results  do  not  warrant  rejection  of  that  methodology,  they  do  call 
it  into  question  and  argue  strongly  for  future  USAP  investigation  of  this 
area. 
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37. 


Goldstein,  D.A.  and  King,  W.J.  Transfer  Retention  for  Verbal  and  Motor 
Tasks , Technical  Report  U411-61-06A,  Electric  Boat  Division,  General 
Dynamics  Corporation,  Groton,  CT,  April,  1961. 


1.  Summary 

Transfer  retention  effects  over  no-practice  intervals  varying  from 
10  minutes  to  4 months  were  examined  for  a verbal  task  and  a motor  task. 
The  general  concern  was  with  determination  of  desirable  characteristics 
for  transfer  from  a training  task  (e.g.,  a simulator)  to  an  operational 
task  as  a function  of  time.  Results  indicated  that  changing  either  the 
stimulus  or  response  aspects  of  the  verbal  task  decreased  transfer  over 
all  time  Intervals,  whereas  for  the  motor  task  the  stimulus  aspects  can 
be  changed  (within  limits)  without  significant  effect  as  long  as  the 
response  aspects  remain  compatible.  However,  as  the  no-practlce  inter- 
val Increases,  the  relative  decremental  difference  between  stimulus  change 
and  response  change  effects  decreases  for  the  motor  task. 

2.  Comment 


This  study  used  very  simple  tasks,  a factor  that  may  limit  its  appli- 
cability. However,  the  authors  conclude  the  following  with  reference  to 
transfer  effects:  (1)  for  verbal  tasks  consisting  of  discrete  stimulus- 

response  units  (e.g.,  paired  associates),  the  characteristics  of  the  train- 
ing task  should  closely  correspond  to  those  of  the  operational  task,  re- 
gardless of  length  of  time  between  training  and  task  performance;  aid  (2) 
that  for  motor  tasks  involving  continuous  cracking,  the  characteristics  of 
the  stimulus  during  training  can  differ  somewhat  from  those  of  the  opera- 
tional task.  If  the  response  elements  are  common,  without  serious  effect 
for  periods  up  to  one  week  — beyond  one  week,  both  stimulus  and  response 
can  be  changed.  This  study  adds  little  to  our  practical  knowledge  of  long- 
term retention. 
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hO.  Grimsley,  D.L.  Acquisition,,  Retention  and  Retraining;  Effects  of  High 
and  Low  Fidelity  Training  Devices.  HumRRO  Technical  Report  69-1,  Ruman 
Resources  Research  Office,  Alexandria,  VA,  February  1969. 

41.  Grimsley,  D.L.  Acquisition,  Retention  and  Retraining t Group  Studies  on 
Usina  Low  Fidelity  Training  Devices.  HumRRO  Technical  Report  69-4,  Human 
Resources  Research  Office,  Alexandria,  VA,  March  1969. 

42.  Grimsley,  D.L.  Acquisition.  Retention  a*»i  Retrainine;  Training  Category 

IV  Personnel  vith  Low  Fidelity  Devices.  Technical  Report  69-12, 

Human  Resources  Research  Office,  Alexandria,  VA,  June  1969. 


1.  Summary 

In  this  series  of  related  studies,  the  effect  cf  device  f:  r > ity  on 
the  acqcMitlon,  retention,  and  retraining  of  missile  system  pro  edural 
skills  was  examined.  Devices  varied  from  a high  fidelity  representation 
of  the  Nike-Hercules  control  panel  to  an  artist's  representation  of  same. 
Retention  over  four-  and  six-week  intervals  was  studied.  Results  showed 
no  effects  of  device  fidelity  on  acquisition,  retention,  or  relearning  of 
these  procedures  and  that  the  bulk  of  the  decrement  occurred  in  the  first 
four  weeks. 

2.  Comment 


Though  the  system  studied  is  quite  different  from  an  aircraft,  the  data 
are  consonant  with  most  studies  of  procedures  retention  in  aircraft  skills. 
The  high  levels  of  procedures  skill  attainable  with  inexpensive,  low-fidel- 
ity devices  supports  the  use  of  such  devices  in  aircraft  proficiency  main- 
tenance or  retraining  programs. 
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44.  Hammerton,  H.  "Ret&ntlon  of  Learning  in  a Difficult  Tracking  Taak/' 
J.  Expev.  Paychol.,  1963,  6^,  108-110. 


1.  Summary 

Thle  study  investigated  retention  of  aklll  in  a second-order  (accel- 
eration control)  tracking  task.  The  task  consisted  of  capturing  a light 
spot  target  presented  on  a CRT  with  a joy-stick  control  and  moving  It  to 
a center  target  zone  for  a specified  time.  Two  levels  of  initial  training 
were  used,  and  retention  over  a 26-week  interval  was  Investigated.  Results 
showed  a five-fold  Increase  In  target  acquisition  time  after  the  retention 
interval  for  the  lesser  trained  group  and  a two-fold  Increase  for  the  higher 
trained  group. 

/ 

2.  Comment 


This  study,  in  contrast  to  tnuch  of  the  motor  skills  research  literature, 
shows  a significant  decrement  in  performance  after  six  months  without  prac- 
tice. The  author  concludes  that  uae  of  a higher-order  control  system,  with 
the  consequent  increase  in  task  dlfflcultyv  accounts  for  the  performance 
decrement.  He  also  concludes  that  overlearning  should  be  recommended  for 
■’^fflcult  r-'sks  when  first-trial  performance  is  Important,  but  because  of 

reltscrr  mg  ^nat  overlearning  need  not  be  used  when  circumstances  will 
pet  ,.c  refresher  trainit.g  before  the  criterion  task  must  be  performed.  This 
result  suggests  that  fox  evei  the  more  difficult  aspects  of  ilSAF  piloting 
motor  skills,  retraining  shculd  be 
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62.  Melton,  A.W.  Retention  of  Tracking  Skllla.  Department  of  Paychology, 
University  of  Michigan  ORA  Project  02855,  1964. 


1.  Sunnnary 

This  laboratory  study  Investigated  the  retention  of  a tracking  skill 
as  a function  of  type  of  display-control  relationship,  type  of  target 
motion,  and  retention  Interval.  The  task  Involved  use  of  a stick  to  con- 
trol an  oscilloscope  target  whose  motion  was  either  patterned  or  random. 

The  relationship  of  stick  movement  and  target  motion  could  either  be  com- 
patible (i.e.,  R-R  and  L-L)  or  incompatible  (R-L  and  L-R) . Retention  in- 
tervals were  5 minutes,  1 day,  and  1 week.  Results  showed  decrements  after 
the  1 day  and  1 week  Interval,  with  the  decrement  being  more  pronounced 
for  the  incompatible  control-motion  relationship. 

2.  Comment 


This  effort  was  the  culmination  of  a series  of  studies  relating  to  the 
Interference  theory  of  forgetting.  The  major  point  of  interest  with  res- 
pect to  current  USAF  problems  may  be  the  conclusions  relating  to  the  effects 
of  control-display  compatibility  on  retention.  An  interesting  sidelight  of 
one  of  the  preliminary  studies  in  this  series  was  the  finding  that  male  Ss 
exhibited  superior  tracking  skill  performance  compared  to  that  of  female 
Ss,  with  the  difference  being  quite  pronounced  for  the  incompatible  control- 
display  condition. 


I 


Retention  of  skill  in  the  Bachman  ladder  climb  task  by  female  sub- 
jects was  examined  for  five  time  periods  varying  from  10  minutes  to 
13  weeks.  Retention  was  found  to  be  virtually  perfect  for  all  five  re- 
tention periods  examined,  with  no  differences  among  the  five  groups. 

2.  Comment 

This  task  has  little  relevance  to  flying,  other  than  the  fact  that  it 
is  a complex  motor  coordination  cask.  It  should  also  be  noted  that  none 
of  the  groups  had  approached  asymptotic  performance  levels  prior  to  the 
retention  interval.  However,  the  results  do  suggest  that  retention  for 
some  motor  skills  can  remain  extremely  high  over  the  time  periods  tested. 
In  a companion  article  in  the  same  periodical  (1968,  314-320),  the 

author  reexamined  these  data  to  assess  effects  of  retention  interval  on 
the  correlation  of  last  learning  trial  with  first  retention  trial.  She 
found  that  this  correlation  declined  as  the  retention  interval  became 
longer . 
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75.  Noble,  M,  and  Trumbo,  D.  "The  Organization  of  Skilled  Responiie." 

i Organizational  Behavior  and  Human  Performance,  1967,  2,  1~25. 

I . 

100.  Swlnk,  J.,  Trumbo,  D.  and  Noble,  M.  "On  the  Length*Dl££lculty  Relation 
in  Skill  Performance."  J.  Exper.  Paychol.,  1967,  7^,  356-362. 

j 

103.  Trumbo,  D. , Noble,  M. , Cross,  K.  and  Ulrich,  L.  "Task  Predictability  in 
the  Organization,  Acquisition,  and  Retention  of  Tracking  l^kllls."  J.  Exper. 

I Psychol..  1965,  70,  252-263. 

104.  Trumbo,  D. , Noble,  M. , and  Swink,  J.  "Secondary  Task  Interference  in  the 
Performance  of  Tracking  Tasks."  J.  Exper.  Psychol.,  1967,  7]l*  232-240. 

i . 

105.  Trumbo,  D. , Ulrich,  L.,  and  Noble,  M.E.  "Verbal  Coding  and  Display  Coding 
in  the  Acquisition  and  Retention  of  Tracking  Skill."  J.  Appl.  Psychol., 
1965,  49,  368-375. 


1.  Summary 

This  series  of  related  studies  investigated  effects  of  a variety  of 
variables  on  retention  of  a CRT  pursuit  tracking  skill.  Factors  inves- 
tigated Included  training  level,  task  predictability,  sequence  length, 
rehearsal,  secondary  task,  and  retention  Interval. 

2.  Comment 

Results  of  these  studies  confirm  the  Importance  of  the  factors  studied 
on  retention.  They  are  generally  consonant  with  the  results  of  other  in- 
vestigations In  task  settings  more  closely  approximating  those  of  the  USAF 
pilot. 
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Ryan,  E.D.  "Retention  of  Stabllometer  Performance  Over  Extended  Perloda 
of  Time."  The  Research  Quarterly,  1965,  36,  46-51. 


1.  Summary 

Retention  of  a gross  motor  balancing  task  was  examined  over  three 
time  periods  (3,  6,  and  12  months).  Results  showed  large  performance 
decrements  for  all  groups,  with  amount  of  decrement  directly  related  to 
length  of  retention  Interval.  Relearning  was  rapid,  but  was  slower  for 
the  longer  retention  period  groups. 

2 . Comment 


This  task  has  little  relevance  to  flight  tasks,  but  the  results  are 
somewhat  at  variance  with  other  similar  studies.  Of  Interest,  though. 

Is  that  correlation  of  last  training  trial  and  first  retention  trial  did 
not  differ  as  a function  of  retention  Interval. 


Bahrlck,  H.P.  "Retention  Curves;  Facts  or  Artifacts?"  Peychol.  Bull. 
196A,  61,  188-194. 


This  paper  examined  the  question  of  comparability  of  retention  curves 
as  a function  of  method  of  measuring  retention  (i.e.,  recognition  vs.  re- 
call or  anticipation  methods).  The  author  concludes,  contrary  to  previous 
investigators,  that  they  are  generally  comparable.  This  study,  which  deals 
primarily  with  verbal  learning,  is  of  little  pertinence  to  skill  retention, 
but  it  does  point  up  the  bearing  that  method  of  measure  can  have  on 
conclusions  drawn  from  retention  data. 


Brown,  D.R.,  Briggs,  G.E.,  and  Naylor,  J.C.  The  Retention  of  Discrete 
and  Continuous  Tasks  as  a Function  of  Interim  Practice  with  Modified  Task 
Requirements.  Technical  Documentary  Report,  AMRL-TDR-63-35 , Aerospace 
Medical  Research  Laboratories,  Wrlght-Patterson  AFB,  OH,  1963. 


The  effect  of  rehearsal  conditions  on  retention  of  tracking  and  pro- 
cedural skills  was  examxned  in  this  laboratory  study.  Rehearsal,  inter- 
polated mid-way  through  the  37-day  rententlon  interval,  facilitated  track- 
ing skill  retention  over  non-rehearsal.  Rehearsal  also  facilitated  pro- 
cedures retention.  ' 


Duncan,  C.F.,  and  Underwood,  B.J.  "Retention  of  Transfer  in  Motor  Learning 
After  24  Hours  and  After  14  Months."  J.  Exper,  Psychol.,  1953,  4jb,  445-452. 


This  study  examined  retention  of  transfer  effects  over  1 day  and  14 
month  time  periods.  Results  show  proactive  inhibition  effect  in  a posi- 
tive transfer  situation  over  the  14  months  period. 


Leavitt,  H.J.  and  Schlosberg,  H.  "The  Retention  of  Verbal  and  Motor 
Skills."  J.  Exper.  Psychol* > 1944,  404-417. 


Retention  of  nonsense  syllables  and  pursuit  rotor  performance  was 
examined  for  periods  up  to  70  days.  Results  showed  better  retention 
of  the  motor  skill. 


McDonald,  K.D.  Retention  of  Military  Skills  Acquired  In  Baalc  Combat 
Training.  HumRRO  Technical  Report  67-13,  Human  Resources  Research 
Office,  Alexandria,  VA,  December  1967. 


This  study  examined  performance,  at  several  points  In  time,  of  Army 
personnel  on  (1)  basic  rifle  marksmanship,  (2)  physical  combat  profi- 
ciency, and  (3)  an  end-of-cycle  teat  covering  military  subjects  taught 
in  basic  combat  training.  Results  showed  statistically  significant  decre- 
ments in  performance  as  a function  of  time  since  training  (up  to  one  year) . 
Decrements  were  of  little  practical  concern,  however.  This  was  not  a well- 
controlled  study  because  of  prevailing  circumstances.  Due  to  this  and  the 
nature  of  the  tasks  studies,  it  is  of  little  relevance  to  flight  skill 
retention. 


Melnlck,  M.J.,  Lersten,  K.C.,  and  Lockhart,  A.S.  "Retention  of  Fast 
and  Slow  Learners  Following  Overlearning  of  a Gross  Motor  Skill." 

J.  Motor  Behavior,  1972,  4,  187-193. 


Retention  of  stabilometer  balancing  skill  over  a one  week  period 
was  examined  as  a function  of  whether  the  S was  classified  as  a slow, 
medium,  or  fast  learner  during  original  training.  Each  S received 
lOOX  overlearning  after  achieving  criterion  performance,  followed  by 
the  one  week  retention  interval.  No  significant  difference  in  amount 
retained  was  found  among  the  groups,  though  the  results  did  favor  the 
faster  learners. 


Naylor,  J.C.  and  Briggs,  G.E.  "Effect  of  ReheaLsal  of  Temporal  and 
Spatial  Aspects  on  Long-Term  Retention  of  a Procedural  Skill."  J. 
Appl.  Pshchol.,  1963,  120-126. 


Whole  task  rehearsal  was  found  superior  to  other  methods  for  a 
procedural  task,  but  orly  for  errors  of  commission. 


72.  Naylor,  J.C.,  Briggs,  G.E.,  Brovm,  O.R.,  and  Reed,  W.G.  The  Effect  of 
Rehearsal  on  the  Retention  of  a Time-Shared  Task.  Technical  Documentary 
Report  No.  AMRL-TDR-63-33,  Aerospace  Medical  Research  Laboratories,  Wright- 
Patterson  AFB,  OH,  April  1963. 


Whole-  and  part-task  rehearsal  conditions  were  examined  in  terms  of 
their  effects  on  retention.  Results  showed  whole-task  rehearsal  to  be 
superior  up  to  five  days,  part-task  rehearsal  superior  at  ten  days,  and 
no  rehearsal  effects  were  noted  when  the  Interval  was  greater  than  ten 
days . 


81. 


Roehrlg,  W.C.  "Paychomotor  Tasks  with  Perfect  Recall  after  50  Weeks  of 
No  Practice."  Perceptual  and  Motor  Skills,  1964,  1^,  547-550. 


Seven  subjects  were  tested  for  retention  of  a whole-body  balancing 
skill  after  a period  of  50  weeks  without  practicing  the  task.  For  all 
subjects,  retention  was  virtually  perfect,  and  their  performance  during 
further  training  after  the  initial  retention  trial  continued  to  Improve 
as  if  there  had  been  no  break  in  their  training.  The  author  believes 
this  to  be  the  only  documented  instance  of  such  complete  retention  over 
an  extended  time  interval.  He  suggests  the  high  motivation  level  of  the 
subjects  (the  task  had  great  appeal)  as  a possible  explanation.  The  task 
studied  here  has  little  resemblance  to  flying  tasks,  and  this  result  would 
seem  to  have  no  particular  pertinence  to  flying  skill  retention. 


108.  Van  Dusen,  F. , and  Schlosberg,  H.  "Further  Study  of  the  Retention  of 
Verbal  and  Motor  Skills."  J.  Exper.  Psychol.,  1948,  38,  526-534. 


1 


Results  of  this  comparison,  involving  intervals  up  to  28  days,  indi- 
cated no  difference  in  retention  of  verbal  and  motor  skills  when  task 
integration  or  organization  is  equal. 


Vlneberg,  R.  A Study  of  the  R«tantlon  of  Skills  and  Knowledge  Acquired 
In  Baplc  Training.  HumRRO  Technical  Report  75-10,  Human  Resourcee  Reeearch 
Organisation,  Alexandria,  VA,  June  1975. 


Retention  of  material  learned  during  Army  basic  training  was  measured 
six  weeks  after  completion  of  basic  training.  Probability  of  passing 
dropped  from  81%  at  the  end  of  basic  tv.alning  to  65%  six  weeks  later. 
Performance  of  Mental  Category  H soldiers  was  significantly  better  than 
that  of  Categories  III  and  IV  personnel  at  both  points,  but  there  was  no 
difference  in  performance  of  Categories  III  and  IV  personnel. 
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V.  MISCELUNEOUS  AVIATION  STUDIES 


In  the  course  of  the  literature  review,  many  studies  dealing  with 
flying  skills,  learning,  flight  safety,  and  aviation  in  general  were 
examined.  No  attempt  has  been  made  to  cover  these  areas  exhaustively, 
but  a number  of  such  Items  that  surfaced  In  the  search  procedure  are 
included  here  as  being  of  some  pertinence  and  interest. 

Since  the  subjects  of  Initial  acquisition  (learning)  of  flying  skills, 
maintenance  of  proficiency,  forgetting/retention  of  flying  skills,  and 
reacqulsltlon  (retraining)  or  transfer  of  flying  skills  are  all  closely 
related.  It  is  obvious  that  a study  dealing  with  conditions  that  foster 
the  learning  of  flight  skills  may  be  pertinent  to  the  present  problem  con- 
text  of  retention.  Therefore,  certain  of  these  are  included  In  this 
section.  Examples  of  such  topic  areas  of  concern  to  USAF  with  reference 
^0  the  retention  problem  are  use  of  simulators  for  cost-effective  (re) train 
Ing,  the  nature  of  the  pilot  task,  performance  measurement  techniques, 
pilot  motivation,  accident  experience,  and  the  like. 
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American  Airlines.  Optimized  Flight  Crew  Training;  A Step  Toward  Safer 
Operation.  American  Airlines  Flight  Training  Academy,  Fort  Worth,  TX, 
April  1969. 


1.  Summary 

This  report  describes  the  effort  by  American  Airlines  to  develop 
an  Improved  flight  crew  training  program  involving  major  reliance  on 
the  use  of  flight  simulators,  training  to  proficiency,  and  similar  fac- 
tors that  are  today  routine  aspects  of  airline  training.  It  was  not  so 
much  a research  study,  as  an  advanced  development  activity  involving 
a variety  of  training  concepts  developed  elsewhere.  The  study  involved 
the  training  of  40  Captains  for  the  B-727  aircraft.  Times  to  reach  re- 
quired proficiency  levels  varied  from  15.2  to  46.7  hours  in  the  simu- 
lator (M  ■ 28.4)  and  from  4.0  to  8.0  hours  in  the  aircraft  (M  » 5.6). 
Average  times  required  in  the  previous  B-727  program  were  18.0  and  8.3 
hours  for  the  simulator  and  aircraft,  respectively.  Conclusions  inclu- 
ded the  following: 

a.  The  optimized  program  will  produce  safer  and  better  qualified 
crewmen  than  conventional  training  programs. 

b.  Simulator  training  to  proficiency  wl^  assure  a high  level  of 
success  in  the  airplane. 

c.  Evaluation  in  the  flight  simulator  is  indicative  of  performance 
in  the  airplane. 

2.  Comment 


This  was  a pioneering  effort  which  demonstrated  the  utility  of  the 
modern  simulator  (with  a visual  system)  as  a means  of  meeting  virtually 
all  the  objectives  of  airline  transition  training.  Even  though  most  of 
the  training  technology  Involved  in  this  program  was  developed  in  mili- 
tary settings,  it  remained  for  the  commercial  carriers  to  Integrate  the 
concepts  into  an  oper^^tional  program  and  to  demonstrate  its  cost  effec- 
tiveness. This  program  was  significant  in  demonstrating  the.  effective- 
ness of  the  approach  used  in  the  training  of  flight  personnel  of  rela- 
tively high  experience  levels.  This  particular  study  sheds  no  light  on 
the  subject  of  long-teuu  retention,  but  it  does  suggest  ways  the  retrain- 
ing can  be  accomplished  in  effective  and  efficient  fashion  for  high  level 
skills. 


27.  Dougherty,  D.,  Houston,  R.C.,  and  Nicklas,  D.R,  Transfer  of  Training  In 
flight  Procedures  from  Selected  Ground  Training  Devices  to  the  Aircraft. 
NAVTRADEVCEN-TR-71-16-16,  U.  S.  Naval  Training  Device  Center,  Port  Wash- 
ington, NY,  1957. 


1.  Summary 

This  study  examined  transfer  of  flight  procedures  for  several  ground 
training  devices  varying  In  fidelity  and  complexity  from  a photographic 
cockpit  mockup  to  an  operational  flight  trainer  with  visual  display.  Re- 
sults showed  substantial  transfer  from  all  devices  to  the  aircraft  for  pro- 
cedural Items.  Transfer  was  less  for  flight  control  Items  for  all  devices, 
and  the  mockup  device  was  significantly  Inferior  to  the  other  devices  for 
flight  control  items. 

2.  Comment 


This  is  a classic  study  of  device  fidelity.  While  it  Is  not  concerned 
with  long-term  retention  of  flight  skills,  it  is  pertinent  because  It  demon- 
strates the  feasibility  of  using  devices.  Including  low-cost  devices,  to 
maintain  or  retrain  the  aspect  of  flight  skill  that  seems  of  moat  concern 
In  terms  of  long-term  retention,  the  execution  of  procedures. 
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29.  Flelahvnan,  E.A.  and  Ornsteln,  G.N.  "An  Analysis  of  Pilot  Flying  Per- 
formance in  Terms  of  Component  Abilities."  J.  Appl.  Psychol..  1960, 
44,  146-155. 


1.  Summary 

This  effort  represented  the  extension  to  flying  skills  of  a long 
series  of  Investigations  by  Fleishman  as  to  the  basic  structure  of  motor 
skills  and  performance.  Objective  flight  performance  data  for  63  USAF 
primary  flight  trainees  were  subjected  to  factor  analysis.  A total  of 
24  flight  maneuvers  were  scored  over  four  successive  flights.  Six  fac- 
tors were  identified  as  underlying  these  flight  performances,  as  follows: 
I - Control  Precision;  It  - Spatial  Orientation;  III  - Multlllmb  Coor- 
dination; IV  - Response  Orientation;  V - Rate  Control;  and  VI  - Kines- 
thetic Discrimination. 

2.  Comment 


This  study  was  the  pioneering  application  of  factor  analysis  method- 
ology to  the  area  of  flying  skills.  It  laid  the  foundation  for  several 
subsequent  investigations  by  Fleishman  and  others  who  have  sought  to  de- 
velop a better  understanding  of  the  nature  of  complex  skills  and  perform- 
ance. While  this  study  does  not  deal  with  long-term  retention,  it  does 
provide  a basis  for  certain  positions  concerning  the  nature  or  structure 
of  what  is  learned,  what  is  retained,  and  what  is  forgotten  in  the  complex 
area  of  flying.  Research  subsequent  to  this  first  factorial  study  of  flying 
skills  suggests  that  this  approach  may  be  fundamental  to  an  understanding 
and  effective  management  of  the  learning  and  forgetting  of  flying  skills. 
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32.  Gabriel,  R.F.,  Burrows,  A. A.,  and  Abbott,  P.E.  Using  a Generaliaed  Contact 
Flight  Simulator  to  Improve  Visual  Time  Sharing.  NAVTRADEVCEN-TR  1428-1, 

U.  S.  haval  Training  Device  Center,  Port  Washington,  NY,  1965. 


1.  Sunaaary 

This  study  Investigated  use  of  a simple  visual  device  and  tachlstoscopic 
speed-reading  training  as  a means  of  enhancing  visual  scan  and  outslde-the- 
cockpit  target  (Intruder)  detection  of  A4  pilots.  Effectiveness  data  were 
based  on  performance  In  a high  fidelity  operational  flight  trainer  with 
visual  attachment.  Results  showed  the  training  improved  probability  and 
speed  of  detecting  front  Intruders  with  no  change  in  flight  control  per- 
formance Indices. 

2 . Comment 


The  significance  of  this  effort  relates  to  its  demonstration  of  the 
potential  for  maintaining  or  retraining  proficiency  In  visual  skills  and 
time  sharing  through  the  use  of  simple  training  devices.  Of  interest  Is 
the  fact  that  the  time  between  the  experimental  training  and  the  transfer 
trials  was  at  minimum  one  month,  and  was  three  months  for  many  subjects. 
This  Indicates  some  retention  over  time  of  the  skills  developed  by  the 
special  training. 
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Goorney,  A.B.  The  Human  Factor  In  Aircraft  Accidents— Invantlgatlon  of 
Beckaround  Factors  of  Mlot  Error  ^icldents.  FPRC  1227  ^Unedited  Draft) . 
Aeronedlcal  Training  Centre,  RAF,  North  Luffenham  (England),  undated. 


1.  Summary 

Records  from  199  pilot  error  accidents,  covering  a two-year  period, 
and  from  a 165  man  control  group  were  examined  in  this  RAF  study.  Vari- 
ables analyzed  Included  experience,  fatigue,  emotional  stress,  inatten- 
tion, medical  factors,  age,  and  environmental  factors.  Aircraft  types 
Included  trainers,  fighters,  bombers,  transports,  and  helicopters.  Re- 
sults suggest  total  experience  and  time  In  type  as  the  factors  most  closely 
related  with  accident.  Age  was  not  found  to  be  a significant  factor,  nor 
was  period  of  continuous  flying  duty  (i.e.,  number  of  years  in  cockpit 
assignments  before  a ground  tour  assignment) . 

2 . Comment 


These  data  are  not  pertinent  to  USAF  long-term  retention  questions, 
with  possible  exception  of  those  dealing  with  age  and  ground  tour  break 
in  flying  duties. 


mr 


’?>*  •■?!  '‘''•'•**l”»’’»a-''ifrT»'tr--!i ,v^Y.'"'“T’gW'» * 1‘* IS! ^ ‘ 


47.  Haygood,  R.C.t  Leshowltz,  B.,  Parkinson.  S.R.,  and  Eddowes,  E.E. 
Visual  and  Auditory  Information  Processing  Aspects  of  the  Acquisi- 
tion of  Flying  Skill.  AFHRL  TR-74-79,  Air  Force  Human  Resources 
Laboratory.  Brooks  AFB,  TX,  December  1974. 

59.  Leshowltz,  B.,  Parkinson,  S.P.,  and  Waag,  W.L.  Visual  and  Auditory 
Information  Processing  In  Flying  Skill  Acquisition.  AFHRL  TR-74-103, 
Air  Force  Human  Resources  Laboratory,  Brooks  AFB,  TX,  December  1974. 


1.  Summary 

This  report  describes  efforts  to  develop  a better  understanding  of 
piloting  tasks  In  terms  of  Information-processing  skills.  It  builds  the 
case  around  concepts  of  modern  Information  theory  and  views  the  pilot 
primarily  as  an  executive  decision  maker  whose  basic  function  is  the 
processing  of  Information.  This  view  Is  contrasted  with  the  more  tradi- 
tional view  of  pilot  skill  as  a build-up  of  habits.  The  authors  review 
Information  theory  In  terms  of  its  relationship  to  flying  activities.  A 
series  of  experiments  Is  described  dealing  with  areas  such  as  visual  and 
auditory  Interference,  digit  span,  and  redundancy.  The  authors  conclude 
that  ".  . .tools  have  been  made  available  with  which  to  probe  nonoptlmal 
processing  strategies  of  student  pilots  and  to  teach  more  effective  tech- 
niques for  flying." 

2 . Comment 


While  the  focus  of  this  effort  was  on  UPT  flying  tasks  and  consider- 
able research  will  be  necessary  before  a usable  model  Is  available,  this 
approach  would  seem  of  importance  to  an  understanding  and  effective  man- 
agement of  the  problems  of  long-term  retention  of  flying  skills.  Most  re- 
tention research,  to  date,  has  concentrated  on  variables  more  relevant  to 
the  "habit  bulld-up"  view  of  flying,  and  relatively  little  attention  has 
been  given  to  retention  under  the  information  processing  model.  For  ex- 
ample, perhaps  the  most  Important  matter  of  concern  in  selecting  Indivi- 
duals for  retraining  after  non-flying  periods  is  whether  or  not  their 
basic  Information  processing  speed  and  capacity  have  declined  below  accept- 
able levels,  if  Indeed,  decline  Is  characteristic  of  such  situations.  In 
any  event,  the  concepts  of  Information  processing  would  seem  to  offer  a 
worthwhile  approach  for  future  USAF  examination  of  long-term  retention 
problems. 
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Hulin»  C.  L.  and  AlvareSi  K.M.  An  Evaluation  of  Three  Poaalble  Explana- 
tions of  the  Temporal  Decay  In  Predicting  Pilot  Proficiency.  AFHRL-TR-71-5, 
Air  Force  Human  Resources  Laboratory,  Brooks  AFB,  IX,  February  1971. 

Hulln,  C.L.  and  Alvares,  K.M.  Three  Explanations  of  Temporal  Changes  In 
Ability-Skill  Relationships;  Literature  Review  and  Theoretical  Analysis. 
AFHRL-TR-71-6,  Air  Force  Human  Resources  Laboratory,  Brooks  AFB,  TX, 
February  1971. 

Hulln,  C.  L.  and  Alvares,  K.M.  Effects  of  the  Man  on  the  Task  in  Complex 
Man-Machine  Systems.  AFHRL-TR  71-7,  Air  Force  Human  Resources  Laboratory, 
Brooks  AFB,  TX,  February  1971. 


1.  Description 

These  three  related  papers  describe  the  background  for  and  an  experi- 
mental evaluation  of  three  alternative  explanations  of  the  relationships 
among  abilities  and  skills.  The  three  theoretical  positions  are:  (a) 

the  changing  task  model ;JL^  (b)  the  changing  subject  model;  ^'and  (c)  the 
changing  task,  changing  subject  model.  This  latter  position  is  propounded 
for  the  first  time  by  the  authors  in  these  papers  and  is  a combination  of 
the  first  two  positions.  The  authors  review  the  literature  in  comprehen- 
sive fashion  as  they  develop  these  alternative  theoretical  positions.  A 
principal  point  of  their  concern  relates  to  the  practical  problem  of  at- 
tempting to  predict  performance  (skill)  from  various  measures  of  ability 
or  aptitude,  and  the  fact  that  the  precision  of  such  predictions  decreases 
as  the  time  between  predictor  measure  and  performance  measure  Increases. 

To  test  these  three  hypotheses,  two  groups  of  students  were  administered 
an  extensive  battery  of  12  ability  tests  at  the  beginning  and  again  at  the 
end  of  a 16-week  period.  The  experimental  subjects  (N->81)  received  basic 
private  pilot  flight  training  during  the  Interval,  whereas  the  control  sub- 
jects (N=74)  did  not.  Inflight  checkrldes,  covering  some  20  flight  maneu- 
vers, were  administered  to  the  experimental  group  at  approximately  the  10, 
25,  and  35  hour  levels. 


~ This  model,  as  exemplified  in  the  work  of  Fleishman,  holds  that  ability 
factors  are  fundamental  and  constant  characteristics  of  the  individual,  but 
the  importance  of  these  different  abilities  in  performing  a given  task  (l.e., 
a skill)  changes  systematically  as  a function  of  level  of  experience  or 
training  on  Che  task. 

2/ 

— The  changing  subject  model,  as  described  by  Adams,  assumes  that  the  abil- 
ities required  to  perform  a given  task  remain  constant,  but  that  training 
actually  changes  the  strength  of  the  underlying  abilities  of  the  individual. 


2.  Reaulf 

a.  Two  factors  were  Identified  ea  basic  to  the  ability  test  battery — 
a spatial-visual  orientation  factor,  and  a mechanical  aptitude  factor. 

b.  There  were  significantly  greater  changes  in  the  ability  scores 
(pretest  to  posttest)  of  the  experimental  group  than  in  the  control  group. 

c.  Predictive  correlations  between  pretest  ability  scores  and  flight 
check  data  declined  over  the  three  flight  check  periods. 

d.  Postdlctive  correlations  between  posttest  ability  scores  and  flight 
check  data  showed  no  change  over  the  three  flight  check  periods. 

e.  The  spatial-visual  factor  correlated  best  with  flight  performance 
at  the  25-hour  check  period. 

f.  The  mechanical  aptitude  factor  correlated  best  with  flight  per- 
formance at  the  10-hour  and  25-hour  check  periods. 

3.  Conclusions 


a.  Support  Is  provided  In  these  data  for  both  changes  In  the  subjects 
and  changes  In  the  task.  Hence,  the  authors  feel  the  combination  model  — 
the  changing  task,  changing  subject  model  — Is  the  most  likely  explanatory 
mechanism. 

b.  The  traditional  distinction  between  underlying  abilities  and  opera- 
tional skills  Is  no  longer  justified. 

c.  Selection  procedures  and  attempts  to  predict  performance  must  take 
Into  account  the  changes  In  abilities  and  tasks  that  occur  as  a result  of 
training  and  their  Interactive  effects. 

d.  Practice  on  a task  may  alter  deficiencies  in  underlying  abilities 
that  existed  prior  to  such  practice. 

e.  These  structural  changes  may  provide  a means  to  alter  practice 
(training)  in  constructive  ways  to  Improve  training  effectiveness  and  to 
cater  to  Individual  differences. 

4.  Comment 

Tlie  line  of  thought  represented  by  these  three  papers  Is  of  considerable 
potential  significance  to  the  area  of  skills  retention,  though  the  studies 
themselves  do  not  touch  the  subject.  Questions  arise,  for  example,  such 
as  the  following:  how  permanent  (i.e.,  their  retention)  are  changes  in 

underlying  abilities  that  occur  as  a function  of  training;  since  such  changes 
occur  as  a function  of  practice,  what  changes  In  abilities  occur  as  a func- 
tion of  non-practice  or  of  other  experiences;  to  what  extent  are  the  changes 
in  task  structure  (I.e.,  the  abilities  used  to  execute  a task)  Idiosyncra- 
tic to  individuals;  do  some  task  structures  (assuming  Idlosyncracy)  result 
in  better  retention  of  performatory  skills  over  periods  of  non-practice; 
etc.  The  significance  of  this  work  to  retention  lies  In  the  suggestion  that 
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the  perfonnance  of  complex  tasks  Is  dependent  on  many  factors  and  varl- 
ablest  some,  or  perhaps  all,  of  which  are  not  fixed  in  amount  or  effect. 
While  these  efforts  were  concerned  with  only  the  rudiments  of  Initial 
flight  training,  extension  of  this  thinking  to  more  complex  flight  skills 
would  force  their  examination  in  ways  that  perhaps  emphasize  factors  other 
than  the  more  traditional  perceptual-motor  views  of  flying.  Little  has 
really  been  done  to  explore  advanced  skills  (and  their  retention)  in  terms 
of  factors  or  functions  such  as  information  processing,  residual  atten- 
tion, decision  making,  crew  and  resource  management,  effects  of  stress, 
and  the  like.  The  line  of  research  represented  in  the  work  of  Hulln  and 
Alvares,  as  well  as  that  of  Fleishman,  Hempel,  Adams,  Corballis,  and  others, 
offers  a means  of  exploring  flight  skills  learning  and  retention  in  ways 
that  may  prove  much  more  valuable  than  those  used  to  date. 


56.  Koonce,  J.M.  Effects  of  Ground~Baged  Aircraft  Simulator  Motion  Condi- 
tions upon  Pr^lctlon  of  Pilot  Proficiency.  Technical  Report  AFOSR 
74-3,  Aviation  Research  Laboratory,  University  of  Illinois,  Savoy,  IL, 
April  1974. 


1.  Summary 

This  study  Investigated  predictive  relationships  between  various 
measures  of  pilot  performance  in  a simulator  with  pilot  performance 
measures  gathered  inflight.  Three  groups  of  thirty  pilots,  each  with 
multi-engine  and  Instrument  ratings,  served  as  subjects.  The  principal 
concern  was  with  the  effects  of  several  simulator  motion  conditions  on 
the  prediction  of  inflight  performance.  In  addition,  data  are  presented 
relating  to  the  relationships  between  certain  background  data  and  inflight 
performance.  Results  showed  sustained  simulator  motion  allowed  more  accu- 
rate predictions  of  inflight  performance  than  did  either  no-motlon  or 
washout-motion  conditions.  Of  the  prior  flight  time  variables,  only  flight 
time  in  the  past  six  months  showed  substantial  correlation  with  flight 
performance.  Correlations  were  low  for  total  flight  time  or  for  various 
categories  of  flight  time  (e.g.,  total  Instrument  time). 

2.  Comment 


The  data  from  this  study  do  not  add  much  to  our  knowledge  of  long-term 
skill  retention.  While  some  of  the  test  subjects  had  not  flown  for  exten- 
ded time  periods,  this  was  not  a variable  on  which  they  were  selected,  and 
no  analyses  are  given  for  any  subgroups  who  had  not  flown  for  extended 
periods.  A reanalysls  of  these  data  along  that  line  would  be  of  interest. 
The  data  do  suggest  several  things  of  some  Interest  relative  to  retention. 
The  finding  that  amount  of  recent  flight  experience  is  related  to  flight 
performance  is  not  surprising,  but  the  finding  that  type  of  recent  flight 
experience  showed  only  low  relationship  to  flight  performance  might  be 
considered  unexpected.  Also  of  interest  was  the  finding  of  substantial 
predictive  relationships  between  simulator  measures  and  Inflight  measures. 
This  lends  credence  to  the  use  of  flight  simulators  as  vehicles  for  study- 
ing retention  of  flight  skill. 


69.  Miller,  R.E.,  Optimal  AsslRntaent  of  Air  Force  Pilots.  ATOM,  TR-73-59. 
Air  Force  Human  Resources  Laboratory,  Brooks  AFB,  TX,  February  1974, 


1.  Description 

In  response  to  TAG  request,  this  study  sought  to  develop  a technique 
for  optimizing  pilot  assignment  within  TAG,  One  constraint  was  that  the 
assignment  system  had  to  be  based  on  Information  or  data  available  at  the 
end  of  UFT.  Peer  rankings  of  pilot  competence  served  as  the  criterion  of 
performance  to  be  optimized.  Peer  rankings,  AFOQT  scores,  UPT  grades, 
and  biographical  data  were  gathered  for  a sample  of  784  TAG  pilots  In 
ranks  1st  LT  through  MAJ.  GorrelaClonal  and  multiple  discriminant  analy- 
ses of  the  data  were  performed  for  transport,  fighter,  and  reconnaissance 
pilot  subsamples. 

2.  Results 

a.  The  peer  rankings  showed  Internal  consistency  agreement  In  41  of 
42  organizations  surveyed. 

b.  Entry  level  TAG  pilots  had  significantly  lover  peer  rankings  than 
did  non-entry  level  TAG  pilots. 

c.  UPT  grades  tended  to  be  positively  related  to  peer  rankings  for 
the  fighter  group  and  negatively  related  for  the  other  groups. 

d.  Cross  validation  multiple  correlations  of  predictors  and  perform- 
ance ranged  .41  - .54. 

e.  An  efficient  discriminant  function  was  developed  Involving  10  vari- 
ables (1  AFOQT  plus  9 UPT). 

f.  Comparing  actual  and  optimal  assignment  for  the  above  average  pilots, 
64%  of  the  fighter  subsample  were  optimally  assigned,  55Z  of  the  transport 
subsample,  and  only  25%  of  the  recce  subsample.  Optimal  percentages  for 
average  and  below  pilots  were  48%,  39%,  and  23%  for  the  three  subgroups, 
respectively. 

g.  The  assignment  procedure  would  have  allowed  optimal  assignment  of 
85%  of  TAG  pilots  on  the  basis  of  total  numbers  of  fighter,  transport,  and 
recce  pilot  positions  In  the  command. 

3.  Conclusions 

a.  Pilots  show  greater  than  chance  agreement  in  their  peer  rankings 
of  pilot  competence. 

b.  Performance  of  fighter,  transport,  and  recce  pilots  can  be  predic- 
ted at  the  end  of  UPT. 
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c.  Predictors  for  one  pilot  specialty  tend  to  be  different  from 
those  of  another. 

d.  The  positive  relation  of  UPT  grades  to  fighter  pilot  performance 
and  negative  to  transport  and  recce  pilot  performance  may  reflect  a 
fighter  emphasis  in  UPT. 

e.  An  efficient  assignment  can  be  made  on  the  basis  of  10  AFOQT 
and  UPT  variables. 

f.  While  most  above  average  pilots  are  optimally  assigned,  the  pro- 
portion of  all  pilots  optimally  assigned  could  be  Increased  to  as  high 
as  85%. 


g.  Optimally  assigned  pilots  are  better  pilots,  as  measured  by  peer, 
rankings,  than  those  not  optimally  assigned. 

4.  Comment 


This  study  Is  abstracted  at  length  here  because  of  the  potential 
utility  of  such  a procedure  for  Identifying  pilots  who  are  the  best  can- 
didates for  retraining  after  periods  of  non-flying.  A predictive  pro- 
cedure could  be  developed  to  predict  level  of  skill  retention  after  non- 
flying  episodes,  though  the  development  of  the  necessary  data  would  be 
a formidable  task.  Similarly,  a prediction  of  quality  of  post  non-flying 
episode  flight  performance  (which  might  be  different  from  the  level  of 
skill  retention  prediction  just  mentioned)  could  be  developed,  given  the 
necessary  data  and  assuming  that  a discriminant  relationship  exists.'  While 
much  research  would  be  requl,.*ed  to  accomplish  these  ends,  an  effective  such 
procedure  would  make  for  much  more  effective  and  efficient  management  of 
the  rated  force  resources.  Ttie  positive  findings  in  Miller's  research  are 
encouraging  for  development  of  such  a procedure. 
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Prather,  D.C.,  '*Pronpted  Mental  Practice  aa  a Flight  Simulator." 
J.  Appl  Psychol..  1973,  353-355. 


1.  Summary 

Thirteen  student  pilots  listened  to  four  12%  minute  tape  recordings 
that  prompted  their  mental  practice  of  landing  the  T-37  aircraft.  Their 
performance  In  landing  the  aircraft  was  compared  with  that  of  10  control 
subjects.  Subjects  had  about  20  hours  experience  In  the  T-41  aircraft 
and  4 hours  In  the  T-37  at  the  time  of  the  study.  Results  showed  Che 
experimental  students  to  perform  significantly  better  (p<.05)  on  both 
landing  technique  and  procedures. 

•f 

2.  Comment 


The  concept  of  mental  practice  la  of  some  Interest  In  long-term  re- 
tention. Mental  rehearsal  or  warmup  has  been  shown  to  aid  task  perform- 
ance after  periods  of  no  practice  In  several  different  flight-relevant 
situations.  The  technique  could  be  of  some  possible  use,  both  In  the 
maintenance  of  skill  levels  during  periods  of  little  or  no  flying,  and 
in  Che  retraining  of  flight  skills  after  extended  no  flying  periods. 
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1X8.  Z«ll«r»  A.F.  "Current  Flying  and  Accident  Potential."  Aeroapace  Medicine. 
1962,  33,  920-929. 


1.  Summary 

Data  were  gathered  concerning  current  flying,  background  experience, 
and  age  for  USAF  pilots  involved  In  over  1,000  jet  aircraft  accidents 
during  the  one-year  period  July  1957-June  1958.  Data  were  compared  with 
those  from  a lOZ  sample  of  all  Air  Force  pilots  flying  comparable  equip- 
ment during  the  same  period.  Accident  rates  were  highest  for  those  pilots 
under  25  and  over  40  years  of  age,  generally,  with  pilots  in  the  30-34 
year  age  group  having  the  lowest  rate.  Rates  were  generally  higher  for 
[|those  %rlth  less  total  experience  or  for  less  experience  of  a pertinent 
\cype  (e.g..  Century  series  accident  rate  as  a function  of  amount  of  Jet 
experience).  In  practically  all  situations  examined,  those  with  greater 
currency  (l.e. , number  of  first  or  Instructor  pilot  hours  in  six-month 
period)  had  lower  accident  rates.  The  author  notes  that  there  are  marked 
differences  In  accident  rate  as  a function  of  aircraft  type,  age,  exper- 
ience, and  other  group  factors,  but  that  the  relationships  were  in  the 
expected  directions  with  reference  to  the  importance  of  currency.  It  Is 
noted  that  pilots  40  years  or  older  should  fly  high  performance  fighters 
only  when  necessary  and  with  high  currency.  However,  this  admonition  does 
not  apply  to  Jet  bomber  pilots ; as  their  accident  rate  shows  little  or  no 
difference  from  that  of  younger  age  groups. 

2.  Comment 


This  Is  an  excellent  overview  of  USAF's  early  experience  with  higher 
performance  aircraft.  While  the  study  does  not  touch  on  retention  of 
flight  skills,  the  comments  concerning  currency,  age,  and  performance  are 
of  interest. 


120.  Zeller,  A.F.  and  Burke,  J.M.  "Relation  of  Time  Between  Flighte  to  the 
Accident  Potential  of  Century  Seriee  Pilots."  Aerospace  Medicine.  1967, 
38,  998-1001. 


1.  Summary 

Time  between  flights  for  204  tactical  and  interceptor  pilots  who  had 
accidents  during  the  years  1963-1964  was  compared  with  that  of  two  matched 
control  groups  of  204  each  who  did  not  have  accidents.  No  differences  were 
found  between  the  accident  and  control  groups.  The  author  suggests  that 
the  strongly  held  belief  that  time  between  flights  is  a strong  accident 
causal  factor  must  be  reexamined. 

2.  Comment 


The  concern  here  was  with  currency  of  pilots  who  were  flying  with  some 
regularity,  rather  than  with  long-term  retention.  Nevertheless,  the  fail- 
ure to  confirm  the  commonly  held  belief  concerning  time  between  flights 
and  accidents  was  a surprise. 


4.  Adams,  J.A.,  Mengelkoch,  R.F.,  and  Gainer,  C.A.  Survey  of  Flying  Pro- 
ficiency Problems  in  the  Naval  Air  Reserve  Training  Command.  NAVTRADEVCEN 
71-16-17,  U.  S.  Naval  Training  Device  Center,  Port  Washington,  NY,  1958. 


The  flying  proficiency  problems  of  selected  Naval  Air  Reserve  units 
were  examined  in  this  study,  and  recommendations  for  Improvement  were 
formulated.  Results  are  of  little  current  interest,  though  reported 
instances  of  forgetting  and  general  flight  skill  deficiencies  are  pro- 
bably typical  of  current  programs. 


IS.  Bowen,  H.M. , Bishop,  E.W. , Promlsel,  D. , and  Robins,  J.E.  Study.  Assess- 
ment of  Pilot  Proficiency.  NAVTRADEVCEN  1614-1,  U.  S.  Naval  Training 
Device  Center,  Port  Washington,  NY,  1966. 


A method  of  measuring  pilot  proficiency  utilizing  the  operational 
flight  trainer  for  the  Navy's  A4  aircraft  is  described. 


16.  Brecke,  F.H.,  Gerlach,  V.S.,  and  Shipley,  B.D.  Effects  of  Instructional 
Cues  on  Complex  Skill  Learning.  AFOSR  TR-75-0201,  Arizona  State  Univer- 
sity, Tempe,  AZ,  August  1974. 


This  study  describes  the  method  used  to  develop  effective  instruc- 
tional cues  for  use  in  cognitive  pretraining.  While  of  no  direct  rele- 
vance to  retention,  the  procedure  could  be  useful  as  a means  of  enhancing 
retraining  of  flight  skills. 
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18.  Briggs,  G.E.,  and  Naylor.  J.C.  "Tha  Ralative  Bfftclancy  of  Sevaral 
Training  Methods  as  a Function  of  Transfer  Task  Complexity."  J.  Expsr. 
Psychol.,  1962,  64,  505-512. 

19.  Briggs,  G.E.,  and  Naylor,  J.C.  "Team  Versus  Individual  Training,  Training 

Task  Fidelity,  and  Task  Organisation  Effects  on  Transfer  Performance  by 
Three-Man  Teams."  J.  Appl.  Psychol.,  1965,  387-392. 

20.  Briggs,  G.E.,  Naylor,  J.C. , and  Fuchs,  A.H.  Whole  Versus  Part  Training 
as  a Function  of  Task  Dimensions.  NAVTRADEVCEN-TR-950-2 , U.  8.  Naval 
Training  Device  Center,  Port  Washington,  NY,  1962. 


This  study  examined  efficiency  of  four  training  methods  In  the 
acquisition  of  training  skill  and  transfer  effects  for  two  levels  of 
task  complexity.  Results  are  of  Interest  In  training,  but  are  not 
directly  pertinent  to  long-term  retention. 


21.  Briggs,  G.E.,  and  Wiener,  B.L.  "Influence  of  Time  Sharing  and  Control 
Loading  on  Transfer  of  Training."  J.  Appl.  Psychol. , 1966,  W,  201-203. 


This  study  Investigated  tracking  task  fidelity  (In  terms  of  control 
loading)  and  Its  effect  on  transfer.  While  of  Interest  to  simulator 
design  and  use,  this  report  is  not  especially  relevant  to  long-term 
retention. 


25.  Copp,  M.R.  Pilot  Age  and  Experience  Versus  Performance  and  Proficiency. 

Operations  ^aiysis  Working  Paper  No.  71-6  (i’ac  OA  WP-7i-6) . Hq.  , tactical 
Air  Command,  Langley  AFB,  VA,  June  1971. 


The  author  reviews  various  safety  studies  and  concludes  that  age 
alone  is  not  the  critical  factor  in  pilot  performance.  Age  must  be 
considered  along  with  experience,  background  aircraft  type,  and  mission. 
The  first  4-5  years  of  flying  are  the  most  dangerous  for  fighter  pilots. 
Jet  fighter  accident  rates  are  nnich  higher  than  for  non-jet.  Age  has 
less  effect  In  prop  AC.  The  writer  cites  data  indicating  that  age  Is 
related  to  training  scores  In  fighter  CCTS.  He  concludes  that  USAF  should 
not  enroll  pilots  in  fighter  CCTS  after  age  35. 
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Gopher,  D.  and  North,  R.A.  The  Measurement  of  Operator  Capacity  by 
Manipulation  of  Dual-Task  Demands.  AFOSR-TR-75-0409.  Aviation  Research 
Laboratory,  University  of  Illinois,  Savoy,  IL,  October  1974. 


This  study  Investigated  a technique  for  measuring  operator  task 
load  and  attention  capacity.  Results  Indicate  that  the  technique  may 
be  useful  in  predicting  flight  performance.  If  the  long-term  skill 
retention  problem  is  conceived  as  being,  at  least  in  part,  one  of  re- 
tention of  information  processing  capability  or  retention  of  pilot 
task  attention  resources,  this  technique  might  be  useful  In  predicting 
pilot  performance  or  retralnabillty  after  extended  non-flying  episodes. 


Meyer,  R.P.,  Laveson,  J.I.,  Welssman,  N.S.,  and  Eddowes,  B.E.  Behavioral 
Taxonomy  of  Undergraduate  Pilot  Training  Tasks  and  Skills i Executive 
Summary.  AFHRL  TR-74-33(I),  Air  Force  Human  Resources  Laboratory,  Brooks 
AFB,  TX,  December  1974. 

Meyer,  R.P.,  Laveson,  J.I.,  Welssman,  M.S.,  and  Eddowes,  E.E.  Behavioral 
Taxonomy  of  Undergraduate  Pilot  Training  Tasks  and  Skills!  Surface  Task 
Analysis.  Taxonomy  Structure,  Classification  Rules  and  Validation  Plan. 

AFHRL  TR-74-33(II) , Air  Force  Human  Resources  Laboratory,  Brooks  AFB,  TX, 
July  1974. 

Meyer,  R.P. , Laveson,  J.I.,  Welssman,  N.S.,  and  Eddowes,  E.E.  Behavioral 
Taxonomy  of  Undergraduate  Pilot  Training  Tasks  and  Skills;  Taxonomy  ^ 
Refinement . AFHRL  TR-74-33(III) , Air  Force  Human  Resources  Laboratory, 
Brooks  AFB,  TX,  December  1974. 

Meyer,  R.P.,  Laveson,  F.I.,  Welssman,  N.S.  and  Eddowes,  E.E.  Behavioral 
Taxonomy  of  Undergraduate  Pilot  Training  Tasks  and  Skills;  Guidelines 
and  Examples  for  Taxonomy  Application  In  Flying  Training  Research.  AFHRL 
TR-74-33(IV) , Air  Force  Human  Resources  Laboratory,  Brooks  AFB,  TX,  December 
1974. 


This  series  of  reports  presents  a methodology  for  task  analysis  and 
classification  of  undergraduate  flying  skills.  The  methodology  is  aimed 
at  development  of  a behavioral  taxonomy  of  such  tasks  and  skills  which,  it 
is  hopes,  will  lead  to  more  efficient  UPT  programs  and  will  provide  gui- 
ance  for  behavioral  research.  While  nothing  in  these  reports  if  of  direct 
pertinence  to  long-term  retention,  the  methodology  might  well  provide  a 
systematic  structure  for  analyzing  retraining  requirements  in  terms  of 
fundamental  flying  abilities,  rather  than  specific  flying  maneuvers  or 
missions,  and,  thus,  allow  development  of  more  effective  and  efficient 
retraining  programs. 
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76.  Parker,  J.F.,  and  Flaiahnan,  B.A.  Prediction  of  Advanced  Levala  of 
Proficiency  In  a Complex  Tracking  Taak.  Report  59-255,  Wright  Air 
Development  Center,  Wrlght-Patteraon  AFB,  OH,  December  1959. 


This  effort  investigated  relationships  of  ability  factors  and  per- 
formance of  a simulated  radar  intercept  task.  While  the  study  is  of 
no  direct  Interest  to  long-term  flight  skill  retention,  the  results 
lend  some  support  to  the  idea  that  the  factorial  structure  of  percep- 
tual-motor skills  changes  as  a function  of  proficiency  level.  Sub- 
jects in  this  study  were  examined  In  a later  study  jL^for  retention  of 
skills.  That  study  la  pertinent  to  USAF  long-term  retention  problems. 


— Fleishman,  E.A.  and  Parker,  J.F.  "Factors  in  the  Retention  and  Re- 
learning of  Perceptual  Motor  Skill."  J.  Exper.  Psychol.,  1962,  64. 
215-226.  ■“ 


78.  Payne,  R.B.,  and  Hauty,  G.T.  "Factors  Affecting  the  Endurance  of  Psycho- 
motor Skill."  J.  Avn.  Medicine.  1955,  26,  382-389. 


Procedures  for  studying  work  decrement  In  pilot  tasks  due  to  fatigue 
are  described.  No  Information  relevant  to  long-term  skill  retention  is 
given. 


98.  Stanley,  M.D.  A Method  for  Developing  a Criterion  for  Combat  Performance 
of  Naval  Aviators.  Masters  Thesis,  Naval  Postgraduate  School,  Monterey, 
CA,  June  1973. 


In  this  report,  methods  for  identifying  effective  and  Ineffective  combat 
pilots  are  discussed.  The.  author  suggests  ratings  in  UPT  based  on  10  fac- 
tors; (1)  Situation  Awareness;  (2)  Procedure  Ability;  (3)  Decision  Making 
Capability;  (4)  Determination/Fixation;  (5)  Stress  Capacity;  (6)  Lack  of 
Preparation;  (7)  Excessive  Concern  with  Self  Image;  (8)  Self  Confidence/ 

Over  Confidence;  (9)  Concern;  and  (10)  Communication. 


99.  Stewart,  W.A.  Pilot  Mana^eroent  Policy  and  Pilot  Training  Ratee.  R-690-PR. 
Rand  Corp. , Santa  Monica,  CA,  March  1971. 


This  report  does  not  deal  with  long-term  skill  retention.  It  does 
Investigate  the  effects  of  various  options  as  to  length  of  Initial  and 
subsequent  cockpit  tours  on  pilot  training  rates,  cost,  and  force  make- 
up. Of  Interest  are  Stewart's  observation  that  It  takes  about  four  years 
of  experience  (1,200  hours)  after  UPT  for  the  pilot  to  become  combat 
effective  and  his  suggestion  that  presumed  negative  results  (morale,  re- 
tention In  service,  motivation,  etc.)  of  changes  In  cockpit  tour  patterns 
may  be  a self-fulfilling  prophecy  that  Is  peculiar  to  the  USAF  career 
system  as  it  Is  presently  structured. 


101.  Taylor,  C.W. , Murray,  S.L. , Ellison,  R.L. , and  Majesty,  M.S.  Development 
of  Motivation  Assessment  Techniques  for  Air  Force  Officer  Training  and 
Education  Programs;  Motivation  for  Pilot  Training^  AFHRL  TR-7i-21.  Air 
Force  Human  Resources  Laboratory,  Brooks  AFB,  TX,  July  1971. 


This  report  describes  an  effort  to  develop  a means  to  assess  Moti- 
vation for  pilot  training  that  would  allow  prediction  of  self-initiated 
elimination  (SIE)  in  UPT.  While  It  does  not  deal  with  long-term/ reten- 
tion, the  report  Is  of  Interest  because  of  the  potential  Importance  of 
motivational  factors  In  the  management  of  the  rated  force  with  reference 
to  periods  of  non-flying. 
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111.  WllllB,  M.P.,  and  Peterson,  R.O.  Deriving  Training  Device  Implications 
from  Learning  Theory  Principles,  Volume  I;  Guidelines  for  Training  De- 
vice Design,  Development  and  Use.  NAVTRADEVCEN  784-1,  U.  S.  Naval  Train- 
ing Device  Center,  Port  Washington,  NY,  July  1961. 

112.  Willis,  M.P.,  and  Peterson,  R.O.  Deriving  Training  Device  Implications 
from  Learning  Theory  Principles^  Volume  II;  Methodology.  NAVTRADEVCEN 
734-2,  uT  Naval  Training  Device  Center,  Port  Washington,  NY,  July  1961. 

113.  Willis,  M.P.,  Rubin,  J.A.,  and  Janesko,  J.F.  Deriving  Training  Device 
Implications  from  Learning  Theory  Principles,  Volume  III;  Specific  Learning 
Principles.  NAVTPJVDEVCEN  784-3,  U.  S.  Naval  Training  Device  Center,  Port 
Washington,  NY,  July  1961. 


This  early  and  ambitious  attempt  to  bring  learning  theory  into  device 
design  in  an  effective  way  has  little  of  pertinence  to  long-term  skill 
retention.  The  exposition  of  the  theoretical  learning  positions  of  Guthrie, 
Hull,  Tolman,  Miller,  Harlow,  Hebb,  Estes,  Skinner,  and  Spence  Is  of  some 
Interest  because  of  the  effort  to  apply  these  theories  to  the  practical 
problems  of  device  design. 


119.  Zeller,  A.F.,  Lentz,  E.C.,  and  Burke,  J.J.  "Current  Flying,  Age,  Exper 
lence  and  Non-Jet  Accidents."  Aerospace  Medicine,  1963,  222-225. 


USAF  experience  with  reference  to  non-jet  aircraft  accidents  Is 
reviewed.  Results  show  that,  in  contrast  to  jet  aircraft,  age  Is  not 
a factor  related  to  frequency  of  accidents  for  pilots  flying  non-jet 
aircraft. 


I 


I 
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VI.  LITERATURE  REVIEWS  AND  REFERENCES 


While  concern  over  long-term  retention  of  flying  skills  has  been 
given  Impetus  by  recent  events,  such  concern  is  not  new.  Consequently, 
several  previous  reviews  of  the  behavioral  science  literature  relevant 
to  this  subject,  or  to  closely  related  areas,  have  been  sponsored  by  the 
military  services  and  NASA.  In  addition,  there  are  several  textbooks  that 
are  particularly  relevant  to  the  subject  of  retention  of  flight  skills. 
These  review  and  reference  Items  have  been  grouped  together  In  this  section 
of  the  report. 

Obviously,  every  major  textbook  on  learning,  experimental  psychology, 
or  general  psychology  la  likely  to  have  sections  dealing  with  memory  and 
forgetting,  with  motor  skills,  and  similar  topics.  No  attempt  Is  made  here 
to  cover  such  Items,  since  they  typically  do  not  treat  the  topic  of  long- 
term retention  of  complex  perceptual-motor  skills  in  detail,  and  seldom 
will  they  contain  any  significant  information  that  Is  not  in  one  of  the 
primary  sources  included  in  this  review. 
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REFERENCES  INCLUDED  IN  SECTION  VI 
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Referenca  # 

" 

1. 

10. 

12. 

13. 
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70. 
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106. 


Author (b) 

Adams 

Bahrlck  (In  reference  lfl2) 

Bilodeau 

Bilodeau  (in  reference  #12) 
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Briggs  (In  reference  #12) 
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I,  Adants,  J.A.  Uunuin  Memory.  Naw  York:  McGraw~Hlll,  1967. 


1.  Sunaary 

Thla  book  provides  a cooprehenslve  treatment  of  the  subjects  of 
memory  and  forgetting.  It  provides  a discussion  of  theories  of  memory, 
and  most  of  the  significant  academic  literature  Is  treated  in  system^ 
atlc  fashion.  While  most  of  the  book  Is  devoted  to  verbal  behavior 
an  emphasis  which,  as  the  author  notes,  characterizes  research  on  learn- 
ing and  retention  — the  subject  of  recall  of  motor  response  Is  (;reated 
In  detail. 

2.  Comment 


Adams  has  been  one  of  the  most  productive  workers  In  the  field  of  human 
memory  over  the  past  quarter  century,  and  this  volume  summarizes  much  of 
his  thinking.  Unlike  many  of  his  academic  colleagues,  Adams'  work  has 
spanned  the  field  from  theory  to  real-world  practical  application.  Much 
of  his  earlier  research  was  concerned  with  pilot  skills  learning  and  re- 
tention. While  this  textbook  Is  aimed  at  the  academic  audience  and  con- 
tains little  data  directly  applicable  to  current  USAF  concerns  with  long- 
term pilot  skill  retention.  It  Is  highly  recommended  to  the  reader  as  basic 
background  In  the  skills  retention  area. 


Bilodeau,  E.A.  (Ed.)  Acqulaltion  of  Skill.  Naw  York  and  London!  Acadasic 
Praaa,  1966. 


1.  SuBBary 

This  la  an  excellent  aource  book  on  the  general  subject  of  skill  ac- 
quisition. Zt  is  a collection  of  papers  presented  by  eminent  researchers 
in  the  field  at  a 1965  conference  on  skill  acquisition.  Topics  Include 
the  history  of  skill  acquisition  research,  individual  differences,  track- 
ing behavior,  motor-akllla  learning,  and  verbal  learning.  Of  particular 
interest  is  Bilodeau's  chapter  on  retention.  Other  portions  of  the  book 
of  pertinence  are  Bahrick's  counents  on  methods  of  measuring  retention, 
Poulton's  chapter  on  tracking  behavior,  Brlgg's  comments  on  Poulton's 
chapter,  and  Underwood's  chapter  dealing  with  motor  skills  and  verbal 
learning. 

2.  Comment 


This  book  presents  contributions  of  18  of  the  most  productive  and  best 
known  researchers  in  the  field  of  skills  learning.  Both  the  academic  and 
applied  settings  are  represented  by  this  group,  many  of  whom  have  conducted 
significant  research  for  the  U.  S.  Air  Force.  The  authors  have  Integrated 
their  many  years  of  research  with  the  general  research  experience  of  others 
into  a most  comprehensive  and  thorough  examination  of  their  subjects.  This 
book  is  excellent  background  for  anyone  desiring  to  dig  in  depth  into  the 
area  of  acquisition  of  skill. 


References  to  these  sections  of  the  book  are  given  In  the  basic  biblio- 
graphic listing  In  Section  III  of  the  present  report. 


Blalwee,  A.S.  and  Regan,  J.J.  An  Integrated  Approach  to  the  Study  of 
Learning,  Retention,  and  Transfer  — A Key  Issue  In  Training  Device 
Reaearch  and  Development.  NAVTRADEVCEN-TR-lH-78,  Naval  Training  Device 
Center,  Orlando,  FL,  August  1970. 


1.  Summary 

The  authors  make  the  point  that  the  topics  of  learning,  retention, 
and  transfer  (LR&T)  are  Inextricably  bound  together,  though  psychologists 
have  often  approached  their  investigation  as  If  they  were  separate.  In- 
dependent topics.  The  closeness  of  their  relationship  Is  of  major  con- 
cern for  the  designer  of  real-life  training  systems,  particularly  when 
the  design  of  training  devices  is  involved.  With  this  background,  they 
describe  attempts  by  NAVTRAOEVCEN  to  bring  information  on  LR&T  together 
for  the  purposes  of  improving  the  operational  uses  made  of  such  informa- 
tion and  to  guide  their  program  of  research.  They  provide  some  brief 
overview  observations  on  the  state  of  knowledge  in  the  LR&T  area  and  a 
tabular  review  listing  of  181  reference  items  dealing  with  LR&T.  Each 
item  is  classified  as  to  nature  of  the  research,  task,  transfer  relation- 
ship, and  other  independent  variables  involved. 

2,  Comment 

This  item  is  of  some  general  interest  as  a kind  of  overview  of  the 
LR&T  literature.  Vftiile  it  includes  a few  items  of  interest  in  the  con- 
text of  long-term  retention  of  skills,  the  level  of  detail  or  information 
given  is  of  little  use  in  terms  of  direct  application  to  USAF  problems. 

Of  course,  the  intent  was  the  presentation  of  an  integrative  approach  or 
schema  for  examining  the  LR&T  literature  and  for  its  expansion  through 
future  research.  It  was  not  intended  that  the  report  would  present  the 
substantive  details  of  that  literature. 


G«rdlln,  G.R. , and  Sittarley,  T.E.  Dagradatlon  of  Learned  Skill ■:  A 
Revlaw  and  Annotated  Bibliography.  Boeing  Docunient  0180-15680-1, the 
Boeing  Conpany,  Seattle.  WA.  June  1972. 


1.  Suiaaary 

Aa  a result  of  the  variety  of  extended  manned  spaceflight  missions 
that  were  planned  by  the  National  Aeronautics  and  Space  Adi^nlstratlon 
(NASA) • the  Boeing  Company  undertook  a series  of  studies  for  NASA  con- 
cerned with  long-term  retention  of  spaceflight  skills.  One  aspect  of 
that  effort  involved  a review  of  the  literature  dealing  with  retention 
(or  Its  opposite,  degradation)  of  learned  skills. 

The  authors  conducted  a review  of  both  the  general  literature  dealing 
with  long-term  retention  and  the  literature  that  Is  more  specific  to  long- 
term retention  of  tasks  relevant  to  spaceflight.  They  present  rather  de- 
tailed summary  abstracts  for  some  21  reports  of  retention  research  and 
shorter  summary  abstracts  for  25  additional  reports.  In  addition,  a bib- 
liography of  116  items.  Including  those  abstracted.  Is  given. 

In  this  report,  the  authors  present  an  overview  of  the  literature  and 
discuss  certain  of  Its  implications  for  the  manned  spaceflight  program 
and  for  future  retention  research.  In  reviewing  the  literature,  they 
dichotomize  It,  generally.  Into  studies  occurring  prior  to  1960  and  those 
occurring  subsequent  to  that  date.  In  their  examination  of  the  early 
literature  they  rely  principally  on  the  excellent  summary  provided  by 
Naylor  and  Briggs  A'ln  their  1961  publication.  They  retain  the  Naylor  and 
Briggs  schema  for  categorizing  the  early  literature  with  reference  to: 

(a)  task  variables:  (b)  training  variables;  (c)  retention  Interval  vari- 
ables; and  (d)  recall  variables. 

The  more  recent  literature  Is  discussed  In  some  detail,  and  certain 
trends  In  that  research  (variables  studied,  methodological  problems,  etc.) 
are  described.  The  authors  present  the  results  of  their  review  of  recent 
literature  organized  under  four  Independent  variable  headings:  (a)  amount 

of  training;  (b)  duration  of  retention  interval;  (c)  task  organization; 
and  (d)  task  environment.  The  latter  category  includes  equipment  char- 
acteristics. 

The  authors  state  that  level  of  performance  at  the  end  of  training  (or 
Immediately  prior  to  the  retention  Interval)  Is  the  primary  predictor  of 
skill  retention  for  any  given  retention  Interval.  They  emphasize  the  Im- 
portance of  temporal  skills  by  noting  that  some  literature  supports  the 
contention  that  such  skills  are  the  last  to  be  acquired  in  training  and 
the  first  to  be  lost  during  no-practlce  Intervals.  The  lack  of  research 
dealing  with  the  possible  interactions  of  environmental  and  psychological 


— Naylor,  J.D.,  and  Briggs,  G.E.  Long-Term  Retention  of  Learned  Skills: 
A Review  of  the  Literature.  ASD-TR-61-390,  Air  Force  Systems  Conmian^ 
Wrlght-Patterson  AFB,  OH,  August  1961. 


stress  with  retention  is  noted » as  are  difficulties  in  real-world  utili- 
zation of  retention  research  data  due  to  the  contrived  or  artificial  tasks 
used  in  so  much  of  the  retention  research.  The  needs  for  better  measurement 
methodologies  for  retention  studies  and  for  a better  understanding  of  the 
relationship  between  task  elements  or  dimensions  and  actual,  operational, 
mission-oriented  tasks  or  behaviors  are  also  highlighted. 

2 . Comment 


This  is  an  excellent  and  comprehensive  survey  of  the  retention  litera- 
ture. It  is  oriented  toward  the  practical  problems  of  the  manned  space- 
flight  program,  rather  than  any  specific  theoretical  position,  but  the 
coverage  of  the  general  literature  does  not  reflect  undue  bias.  While  the 
review  does  not  provide  direct  guidance  relative  to  current  USAF  profi- 
ciency retention  problems,  it  does  provide  an  excellent  roadmap  to  primary 
sources  of  Interest. 


Naylor»  J.C. , and  BriggR^  G.E.  Long-Tana  Rttentlon  of  taan^Rd  Skills t 
K Ravlaw  of  the  Lltarature.  ASD  Tachnlcal  Report  61-390,  Air  Force  Syataiua 
Cotnmand,  Wrlght-Patteraon  AFB,  Ohio,  August  1961. 


1.  Suanary 

The  Air  Force  has  had  a general  interest  in  long-term  retention  of 
skills  for  many  years,  but  as  manned  spaceflight  began  to  move  from  the 
realm  of  fantasy  to  fact  in  the  early  1960s,  that  interest  Increased. 

As  part  of  the  Air  Force  investigation  of  techniques  to  sustain  and/or 
promote  the  retention  of  learned  skills  over  relatively  long  periods  of 
time  without  direct  task  performance,  Naylor  and  Briggs  undertook  a 
systematic  review  of  the  retention  literature. 

In  their  review,  Naylor  and  Briggs  cover  some  123  items,  all  but  six 
of  which  are  taken  from  professional  Journals  or  textbooks.  While  some 
of  the  Journal  articles  are  based  on  work  that  was  conducted  In  something 
pf  an  applied  setting  (as  in  the  USAF  Behavioral  Sciences  Laboratory) , 
the  great  bulk  of  this  literature  was  based  on  research  conducted  in  var- 
ious university  laboratories  and  tends  to  reflect  concern  for  theoretical 
considerations.  The  spurt  of  recent  Interest  in  the  subject  of  retention 
Is  reflected  in  the  fact  that  almost  half  of  the  items  reviewed  by  Naylor 
and  Briggs  were  published  in  the  1950s.  Interestingly,  the  only  1960  item 
they  cover  is  the. study  of  the  forgetting  of  instrument  flight  skills  by 
Mengelkoch  et  al  _/  that  remains  today  as  one  of  the  most  significant  studies 
of  flight  skill  retention. 

In  describing  the  early  work  on  retention,  the  authors  note  that  it 
suffers  (In  terms  of  the  practical  problem  context  of  flight  skills)  from 
an  emphasis  on  verbal  learning  retention,  as  opposed  to  perceptual-motor 
skills  retention,  and  from  dealing  with  retention  intervals  much  shorter 
than  those  of  interest  to  USAF. 

The  authors  discuss  the  retention  literature  in  terms  of  four  cate- 
gories: (a)  task;  (b)  original  learning  conditions;  (c)  retention  condi- 

tions; and  (d)  recall  conditions.  Their  general  conclusions  In  each  nf 
these  areas  are  quoted  as  follows: 

Retention  as  a Function  of  the  Task 

*'l.  There  appears  to  be  little  or  no  evidence  to  support  the  hypothesis 
Chat  motor  tasks  are  intrinsically  less  susceptible  to  forgetting  than  are 
verbal  tasks. 

2.  While  research  has  Indicated  differential  retention  for  continuous 
versus  discrete  or  procedural  tasks  (in  favor  of  the  continuous  task),  this 
does  not  support  the  above  hypothesis  that  motor  tasks  are  retained  better 
than  verbal  tasks. 


— ' Mengelkoch,  R.F.,  Adams,  J.A.  and  Gainer,  C.A.  The  Forgetting  of  Instru- 
ment Flying  Skills  as  a Function  of  the  Level  of  Initial  Proficiency.  Tech- 
nical Report  NAVTRADEVCEN  71-16-18,  U.  S.  Naval  Training  Device  Center,  Port 
Washington,  New  York,  1960. 
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3.  R«c«ntion  dlf,£*rence«  b«tw«en  motor  (contlnuoutt)  and  vorbal 
(procadural  or  diacreta)  taaka  may  be  a function  of  "'task  integration" 
or  the  meaningful  patterning  of  reaponsee.  To  the  extent  that  e teak  is 
compoaed  of  reeponaea  in  random  order  or  without  aome  degree  of  logical 
ee«]iuential  patterning^  to  that  extent  the  taek  may  involve  rapid  forgetting 
following  training." 


Retention  as  e Function  of  Original  Learning  Conditione 

II  II  ll|■lll  1 1 ■ > ■ »— ■— w««eea»^iiwiitiiii  I > iii 

,"1.  Retantlon  appears  to  be  related  in  a positive  but  negatively 
accelerated  fashion  to  aoK>unt  of  orlgi;«al  learning  for  both  simple  and 
complex  teaks. 


2.  In  spite  of  the  fact  that  distributed  practice  leads  to  faster 
ec<]uisltion,  it  does  not  appear  to  facilitate  retention. 

3.  Whole  learning  may  lead  to  better  retention,  especially  for  more 
complex  tasks. 


4.  Verbal  practice  of  a motor  skill  during  acquisition  results  in 
better  retention  than  no  practice,  but  In  poorer  retention  than  actual 
task  practice. 

5.  When  the  retention  task  is  completely  specified,  specific  training 
is  superior  to  varied  task  training;  however,  when  the  retention  task  has 
some  degree  of  uncertainty,  varied  training  is  superior  to  specific  train- 
ing, especially  as  the  amount  of  such  training  is  increased. 

6.  HotivaClonal  factors  during  learning  may  reflect  themselves  in 
retention,  at  least  on  the  more  simple  motor  tasks. 

7.  Underwood's  (1949)  hypothesis  that  most  conditions  which  lead  to 
more  rapid  learning  result  in  better  retention  does  not  seem  substantiated 
in  the  area  of  motor  skills. 


8.  The  effects  of  hypnosis  on  retention  appear  to  be  positive  and 
this  suggests  the  utility  of  such  a technique  for  the  training  and  reten- 
tion of  at  least  simple  procedural  skills.  The  danger  here,  however,  is 
that  it  is  not  possible  to  anticipate  the  exact  conditions  under  which 
operational  use  of  previously  learned  habits  may  occur.  Thus,  a "built 
in"  automaticlty  of  response  could  prove  disastrous  under  conditions  simi- 
lar to  but  requiring  responses  differing  from  those  in  the  original  train- 
ing." 


Retention  as  a Function  of  Conditions  During  Retention  Period 

"1,  Large  losses  in  skill  occur  over  time;  however,  the  actual  function 
of  the  decrement  appears  to  be  specific  to  the  particular  situational  para- 
meters. 

2.  Rehearsf4\fa5:illtate8  skill  retention,  and  the  greater  the  degree 
of  overt  activityviin  rehekrsal,  the  greater  the  facilitation, 

3. ‘  The  poorer  the  fidelity  of  the  rehearsal  task  to  the  originally 
learned  task,  the  less  beneficial  is  rehearsal." 


Rttentlon  «■  a Function  of  Recall  Conditions 


"1.  The  choice  of  a particular  retention  meaaure  can  affect  the 
degree  of  retention  exhibited.  For  tnis  reaeon . it  Is  euggeeted  tltat 
the  criterion  for  evaluating  retention  in  an  experiment  should  always  be 
the  one  that  is  important  in  the  operational  task. 

2.  Retention  of  skill  is  directly  related  to  Che  degree  to  which  the 
retention  environment  Is  replicated  during  original  learning. 

3.  Warm-up  activity  prior  to  reteot  facilitates  the  retention  pro- 
cess. 

4.  Hypnosis  facilitates  recall,  especially  when  the  original  learning 
occurred  under  hypnosis.  It  Is  proposed  here  that  the  facilitating  effect 
of  hypnosis  during  recall  is  due  to  the  fact  that  extraneous  stimuli  and 
competing  response  tendencies  are  minimized  under  hypnosis  which  Is,  after 
all,  0 condition  under  which  the  subject’s  attention  is  narrowed  to  a few 
apetlflc  otlmull." 

While  the  authors  do  not  attempt  to  draw  any  over-all  conclusions  from 
the  literature,  they  do  note  that  the  Importance  of  "task  organization"  as 
a factor  in  retention  is  great  and  tliat  it  is  an  area  in  need  of  more  atten- 
tion. This  factor,  they  feel,  may  account  for  the  generally  popular  con- 
ception (or  misconception)  that  control  skills  are  better  retained  than 
procedural  skills.  They  touch  on  needs  for  further  research  in  a variety 
of  areas,  particularly  methods  of  measuring  retention. 


2 . Comment 


This  review  provides  an  excellent  overview  of  the  more  classical  litera- 
ture on  long-term  skills  retention  up  to  1960.  It  is  presented  in  stan- 
dard review  format  and  providec  intergrative  commentary  pertinent  to  a theo- 
retical understanding  of  forgetting.  It  is  a valuable  background  document 
tor  a general  understanding  of  retention,  but  its  direct  application  to 
current  OSAF  concern  over  flying  skill  retention  is  limited. 


i 


Smith,  J.F.,  and  Matheny,  W.G,  Continuation  Veraua  Racurrant  Pilot 
Training.  AFHRL-TR-76-4,  Air  Force  Human  Resourcea  Laboratory,  Brooks 
AFB,  TX,  May  1976. 


1.  Summary 

In  response  to  current  USAF  concern  over  continuation  (i.e.,  proficiency) 
training  programs,  the  availability  of  resources  to  support  such  programs, 
and  the  readiness  of  the  rated  supplement  force,  the  Human  Resources  Labo- 
ratory conducted  a survey  of  the  literature  on  pilot  skill  retention  and 
developed  pertinent  conclusions  from  that  literature. 

Some  15  references  are  reviewed  briefly  In  the  report.  In  addition, 
six  bibliographic  Items  are  listed,  though  these  are  not  reviewed.  Of 
considerable  Interest  Is  the  authors'  inclusion  of  data  and  discussion  of 
unpublished  material  1.' dealing  with  the  retraining  of  returned  USAF  POWs 
from  Southeast  Asia.  These  POW  returnees  had  from  300  to  over  7,000  hours 
of  total  flight  time  before  being  shot  down,  and  time  as  POW  varied  from 
13  to  102  months.  These  pilots  were  retrained  by  the  Air  Force  in  a highly 
Individualized  training  effort  to  bring  these  pilots  back  up  to  required 
proficiency  levels.  All  training  took  place  at  a single  location. 

Due  to  the  period  of  cessation  of  bombing  of  North  Vietnam  during  the 
conflict,  two  distinct  groups  of  POWs  resulted.  Data  are  presented  for  two 
groups:  (1)  those  whose  non-flying  episode  ranged  from  13  to  34  months 

(M  «■  19  months) ; and  (2)  those  whose  non-flying  period  ranged  from  69  to 
102  months  (M  ■ 84  months) . Retraining  flight  time  for  the  21  pilots  in- 
cluded In  the  shorter  episode  group  averaged  38.4  hours,  while  average  time 
for  the  39  pilots  In  the  longer  episode  group  averaged  45.4  hours.  Average 
retraining  time  for  all  returnees  was  42.2  hours.  Grouping  the  pilots  into 
three  categories  on  the  basis  of  total  flight  time  (Low  « 300  - 1,000  hours; 
Mid  ■ 1,001  - 2,000  hrs.;  and  High  ■ 2,001  - 7,250  hrs.)  resulted  In  statis- 
tically significant  differences  In  retraining  time  between  the  low-time 
group  and  the  other  two  groups.  Mean  retraining  flight  hours  were  48.5, 

35.3,  and  41.6  for  the  Low,  Mid,  and  High  groups,  respectively. 


~ No  formal  publication  dealing  specifically  with  POW  pilot  retraining  is 
known  to  the  present  author.  However,  another  exposition  based  on  the  POW 
retraining  data,  one  somewhat  more  extensive  than  that  of  Smith  and  Matheny, 
Is  contained  In:  Armstrong,  M.B.,  Bleymaler,  J.S.,  Hlnkel,  J.F.,  Levins,  R. , 

and  Sheppard,  R.R.  Flying  Skill  Retention  and  Proficiency  Flying.  Research 
Study  Report  No.  0095-75,  Air  Command  and  Staff  College,  Air  University, 
Maxwell  AFB,  AL,  May  1975. 
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B«8td  on  th«  itudl«a  reviewod  and  tha  POW  retraining  data,  the  authora 
Identify  tha  following  aa  aignif leant  flndlnga: 

(a)  Motor  akilla  aaaoclated  with  VFR  flight  are  retained  longer  and 
regained  nuch  more  quickly  than  inatrument  or  procedural  and  verbal  akilla. 

(b)  Inactivity  for  one  year  reaulta  In  near  maximum  loaa  of  akilla 
(one  eatimate  la  90  percent),  and  aubaequent  perloda  of  inactivity  add 
little  to  average  upgrade  time  requlrementa. 

(c)  If  Inatrument  flight,  akilla  are  maintained  at  a high  level,  contact 
flight  akilla  tend  to  remain  at  an  acceptable  level. 

(d)  Overlearning  promoted  Improved  retention  of  all  categories  of  skills. 

(e)  Simulators  are  effective  In  either  learning  or  relearning  proce- 
dural and  verbal  tasks  and  Inatrument  flying  skills,  and  their  use  should 
significantly  reduce  the  hours  noted  in  paragraph  (f),  following. 

(f)  Retraining  of  contact  and  instrument  aircraft  flight  skills  after 
extended  periods  of  Inactivity  (13  to  102  months)  can  be  completed  In  an 
average  of  45  aircraft  hours  or  less  per  student. 

(g)  Pilots  of  low  experience  levels  (less  than  1,000  hours)  will  re- 
quire more  hours  to  become  recurrent,  but  the  overall  average  should  remain 
below  SO  hours  per  pilot. 

Based  on  these  findings  the  authors  conclude  that  abolition  of  con- 
tinuation training  could  result  In  significant  cost  savings  to  USAP,  and 
that  recurrent  training  could  be  delayed  almost  Indefinitely  until  required 
by  new  job  assignment  or  other  USAP  needs. 

2.  Comment 


While  the  authors  describe  their  review  as  of  limited  nature,  they  have 
touched  on  the  more  significant  available  documents.  The  provision  of  the 
POW  retraining  data  Is  a valuable  addition  to  the  literature.  The  depth 
with  which  the  various  studies  are  reviewed  in  the  Smith-Matheny  report  is 
minimal  (l.e.,  the  amount  of  detail  In  their  written  discussion),  but  their 
conclusions  seem  well-warranted  by  the  present  author's  review  of  the  lit- 
erature. However,  as  Smith  and  Matheny  note,  available  data  are  meager, 
and  more  data  are  needed  to  permit  informed  USAP  policy. 


93,  Smod*,  A.F.,  Beam,  J.C.,  and  Dunlap,  J.W.  Motor  Habit  Interferance:  A 
Reaume  of  the  Literature  and  the  DevelopiiMnt~of  Prtnclplea  for  Tta^^^^^^^ 
mlaation  In  Training.  Contract  No.  2 51 5(00),  Dunlap  and  Aaaociatea, 
Inc.,  Darien,  CT,  January  1959. 


1.  Summary 

Thla  report  examinee  the  concept  of  habit  interference  aa  it  appliea 
to  motor  performance,  particularly  with  reference  to  the  performance  of 
military  joba.  The  firat  section  presents  a rather  comprehensive  review 
<148  references)  of  the  technical  literature  on  habit  Interference.  The 
second  section  presents  certain  principles  of  learning  pertinent  to  mlnl- 
mlaing  effects  of  habit  interference  in  training  activities.  These  prin- 
ciples relate  to  factors  such  as  overlearning,  meaningfulness  of  material, 
transfer  of  general  principles,  perceptual  relations,  guidance,  learning 
to  learn,  practice  schedules,  and  procedural  variables.  The  third  section 
deals  with  the  development  of  more  specific  principles  and  hypotheses  for 
minimising  habit  Interference  as  a function  of  the  type  of  behavior  of 
concern.  These  are  classified  with  reference  to  whether  they  operate  through 
training,  equipment  design,  job  aids,  or  personnel  selection. 

2.  Comment 


While  this  report  does  not  deal  directly  with  the  subject  of  long-term 
retention  of  skills,  it  is  obvious  that  the  concept  of  habit  interference 
is  crucial  to  long-term  retention.  It  is  generally  held  that  forgetting 
occurs  because  of  the  processes  and  activities  that  intervene  between  learn- 
ing and  performance  at  some  subsequent  time;  forgetting  is  not  a "decay" 
process  that  occurs  simply  as  a result  of  the  passage  of  time.  The  pro- 
vision ot  specific  operational  guidelines  for  minimizing  habit  Interference 
by  Smode  at  al  should  be  of  direct  Interest  to  USAF  in  any  future  programs 
of  either  non-flying  or  proficiency  flying  for  personnel  in  the  rated 
supplement.  This  report  is  an  excellent  summary  of  a considerable  body  of 
literature  and  is  recommended  to  the  reader  as  background  for  the  under- 
standing or  the  management  of  the  forgetting/retention  process. 


SiDodt,  A.F.,  Hall,  E.K.,  and  Meyar,  D.E.  An  Aaaaaamant  of  Raaaarch 
Ralavant  to  Pilot  Training.  AMRL-TR-66-196,  Aeroapaca  kalllcal  Raaaarch 
Labor'ator laa , Ur Igh t -Pa t taraon  AFB,  OH,  Novambair  1966. 


1.  Suinmary 

In  this  axcaedlngly  ambitious  work  the  authors  sought  to  provide  the 
Air  Force  a state-of-the-art  survey  of  research  pertinent  to  aviation 
training  and  to  Identify  researchable  Issues  for  Improving  pilot  training. 
Major  sections  of  the  report  deal  with  studies  defining  the  pilot's  job, 
research  relevant  to  pilot  training,  and  studies  concerned  with  Improving 
the  training  system.  They  literally  cover  the  subject  "from  A to  Z," 
utilizing  some  336  references  ranging  from  "Abma"  to  "Zeller."  The  cover- 
age is  very  thorough,  and  the  literature  Is  related  to  major  operational 
and  research  topical  Issues  In  Illuminating  and  competent  fashion. 

In  the  section  of  the  report  concerned  with  research  studies  on  pilot 
training,  the  authors  devote  some  attention  to  the  topic,  "retention  of 
flying  skills."  Their  statements  indicate  that  sensitivity  of  USAF  and 
the  research  community  to  the  significant  Issues  In  the  flight  skill  re- 
tention area  has  existed  for  over  a decade.  The  current  state  of  affairs 
at  the  time  of  the  present  review  (1976)  Indicates  that  relatively  little 
has  been  done  to  advance  our  knowledge  since  the  Smode  ^ ^ review.  . 

In  Identifying  the  significant  research  issues  in  this  area,  the  authors. 
In  addition  to  studies  of  forgetting  per  se,  identify  task  coherency  or 
Integration  and  measurement  as  two  significant  aspects  of  flight  skill  re- 
tention in  need  of  research.  Because  of  the  importance  of  this  report  and 
Its  pertinence  to  current  concerns,  the  following  statements  are  quoted 
(p.  175-176)  from  Smode  et  al: 

"Research  on  retention,  as  presently  conceived,  has  reached 
an  Impasse.  The  same  conclusions  continue  to  be  generated  with 
very  little  additional  substance  added.  Entirely  new  strategies 
for  research  are  required,  set  In  more  operational  situations  in- 
volving complex  behaviors  defining  pilot  performance.  The  obvious 
start  is  with  programmatic  research  which  systematically  investi- 
gates the  complex  of  variables  subsumed  under  retention  and  utilizes 
various  and  lengthy  time  periods  between  learning  and  recall. 

".  . .An  understanding  Is  needed  of  how  behaviors  are  for- 
gotten In  complex  tasks,  and  how  the  forgetting  of  constituent 
components  or  elements  of  behavior  is  related  to  the  total  or  gross 
activity.  A desired  output  would  be  the  determination  of  differ- 
ential deterioration  rates  for  the  classes  of  tasks  found  in  the 
pilot's  Job.  . . . Information  on  the  onset  of  decrement  and  the 
shape  of  the  curve  of  forgetting  over  time  for  each  task  class  should 
be  an  eventual  goal  of  this  research  for  pilot  training.  Retention 
studies  over  long  periods  of  time  are  Implied,  since  the  effects  of 
long-term  retention  of  skills  is  so  important  in  aviation." 


2.  CoiBBwmt 


This  rsport  is  ths  beet  and  nost  comprehensive  source  document  on 
aviation  behavioral  research  available.  The  authors  touched  the  signi- 
ficant centers  of  pilot  training  research,  and  their  literature  coverage 
la  exhaustive,  though  they  focused  in  large  part  on  the  literature  pub- 
lished 1960  and  later.  Whllii  the  scope  of  this  report  la  much  broader 
than  current  USAF  concern  vlth  long-term  retention  of  flight  skills.  It 
Is  highly  recommended  as  a basic  source  document  for  those  Interested  in 
virtually  any  aspect  of  the  pilot  training  process. 


95.  Snoda,  A.F.»  and  Mayar>  D.E.  Raaaareh  Data  and  Information  Ralavant  to 
Pilot  Training;  I.  Caoaral  Paaturtii  of  Air  forca  Pilot  Tralntng  and 
SoBMi  Raaaareh  laauaa.  AkRl.-TR~6^~99  (l) , ju'roapace  t^dical  Raaaareh 
Laboratories.  Wrlght-Patterson  AFB,  OH.  July  1966. 

96.  Smoda.  A.F..  Post.  T.J..  and  Meyar,  D.E.  Rasaarch  Data  and  Information 

Ralavant  to  Pilot  Training; II.  Dascription  of  Pilot  Job  Requiranaot^ 

and  Training  jp>racticas  for  RapVey^^  Associated  Alr^ 

craft.  AMRL-TR>66-99<!ii) . Aarosjpac'aMadlca  Research  Laboratories  * 
Wright-Pat terson  AFB.  OH,  July  1966. 


1.  Summary 

These  two  volumes  present  results  of  an  examination  of  pilot  task  and 
training  requirements  for  aircraft-mission  combinations  representative  of 
all  major  USAF  combat  flying  commands  (SAC.  TAC.  MAC.  and  ADC}.  Volume  I 
describes  general  features  of  USAF  pilot  training  at  UPT  and  CCTS  levels 
and  presents  a number  of  "researchable  issues  for  improving  aspects  of 
pilot  training."  Among  the  issues  identified  are  the  following:  needs 

of  the  CCTS  program;  training  in  target  recognition  and  geographic  orien- 
tation for  low  altitude  flight;  definition  of  the  pilot’s  Job;  the  learn- 
ing environment;  simulation;  measurement;  future  training  requirements; 
field  feedback;  attitudes  and  motivation;  Instructor  effectiveness;  and 
training  materiels  guidelines.  Of  most  Interest  in  the  present  context 
was  the  Identification  of  "maintenance  of  performance"  as  a research  issue. 

In  describing  research  needed  in  this  latter  area,  the  authors  state 
(Volume  I,  p.  34): 

"Research  is  recommended  to  determine  the  quantitative  and 
qualitative  effects  of  disuse  on  performance  and  the  pilot's 
ability  to  retain  what  he  has  learned.  It  is  also  likely 
that  different  types  of  skills  are  differentially  affected 
by  disuse  . . . The  recommended  study  should  provide  data  on 
the  loss  of  ability  through  disuse  and  on  differential  per- 
formance decrements  as  a function  of  level  of  learning  (l.e.. 
flying  experience).  . . . The  results  of  this  inquiry  would 
aid  in  the  development  of  a basic,  or  core,  refresher  train- 
ing exercise  which  could  be  used  to  offset  the  deleterious 
effects  of  disuse.  The  desired  end  product  is  best  described 
as  a technique  for  "peaking"  the  pilot,  l.e.,  for  enabling 
him  to  maintain  a given  skill  level  through  a period  of  mini- 
mal flying  time." 

The  second  volume  is  a detailed  examination  of  the  selected  aircraft 
missions  and  of  the  various  CCTS  training  programs  that  support  those 
missions . 

2.  Comment 


While  these  reports  do  not  contain  specific  information  on  flight  skill 
retention,  they  are  cited  because  of  their  Identification  of  the  research 
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n«ads  In  Che  retention  area.  The  Importance  of  the  retention/forgetting 
problem  has  been  recognized  by  behavioral  scientists  for  many  years,  and 
these  reports  are  an  example  of  such  recognition  with  reference  specifi- 
cally to  USAF  combat  crew  performance. 


115.  Wright,  R.H.  R«vitw  of  Behavioral  Science  R««»arch  Data  Rglavaot  to  Atm 
Proficiency  Flying  Prograwi.  HuoRRO  Coniultlng  Report,  Hui^ 

No.  6 (Aviation),  Fort  Rucker,  AL,  April  1969. 


1.  Sunaary 

The  report  was  prepared  for  the  U.  S.  Continental  Amy  Command  (CONARC), 
now  TRAOOC,  and  provided  the  background  for  Wright's  later  study  of  re- 
tention of  flying  skills  by  Amy  pilots.  The  author  examined  both  specific 
studies  of  flying  skills  (primarily  simulator  studies)  and  laboratory  studies 
as  well  as  general  review  items.  Other  research  agencies  were  contacted, 
and  a limited  opinion  survey  was  conducted  among  Amy  aviators  concerning 
retraining  requirements  and  effects  on  career  decision  plans  of  restricted 
opportunity  to  fly. 

A bibliography  of  76  Items  is  provided  in  this  review,  and  summary 
comments  on  the  overall  literature  are  provided.  Detailed  review  and 
commentary  are  provided  for  six  simulator  studies  of  flight  skill  reten- 
tion, and  short  comments  are  provided  for  four  laboratory  studies.  Tlte 
author's  general  Interpretive  conclusions  from  the  literature  survey  are 
discussed  relative  to  the  topics  of  retention  and  transfer.  Conclusions 
relative  to  retention  were  as  follows; 

(a)  Psychomo(;or  skills,  such  as  controlling  an  aircraft,  deteriorate 
relatively  little  over  periods  of  up  to  two  years,  and  relearning  to  ori- 
ginal performance  levels  should  occur  within,  at  most,  a few  hours. 

(b)  Procedural  skills  that  lack  Inherent  logical  organization  arc 
forgotten  rapidly,  but  regaining  proficiency  requires  less  practice  than 
original  learning. 

(c)  Degree  of  original  learning  and  practice  is  correlated  with  degree 
of  retention  after  an  Interval. 

(d)  Forgetting  curves  have  a negatively  accelerated  fom,  with  greatest 
loss  immediately  after  cessation  of  practice. 

(e)  Degre<^  of  retention  of  a task  appears  to  be  directly  related  to 
its  Inherent  organization.  Tasks  with  a random  structure  arc  forgotten 
rapidly;  tasks  with  high  inherent  organization  are  well  retained. 

(f)  Mental  (imaginary)  rehearsal,  although  not  as  effective  as  actual 
task  practice,  facilitates  retention. 

(g)  The  degree  of  overt  activity  in  rehearsal  is  positively  related 
to  degree  of  recall. 


^ Wright,  R.H.  Retention  of  Flying  Skills  and  Refresher  Training  Require- 
ments; Effects  of^Nonfiying  and  Proficiency  Flying.  HumRRO  Technical 
Report  7^-!32 , Humn  Resources  Research  Organization,  Alexandria,  VA,  December 
1973. 
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(h)  Initial  retention  task  performance  la  directly  related  to  the 
degree  to  which  the  retention  taak  duplicates  the  original  learning  task. 

(I)  Initial  retention  task  performance  Is  directly  related  to  the 
degree  to  which  the  interpolated  period  tasks  duplicate  the  retention  task. 

(J)  Tine  sharing  (i.e.,  the  Integration  of  procedural  and  flight 
control  activities)  appears  subject  to  the  rules  of  forgetting,  and  some 
whole-task  training  appears  necessary  to  restore  full  proficiency  in  time- 
shared  activities. 

After  presenting  these  general  conclualons  from  the  literature,  review, 
the  author  derives  certain  impllcationa  for  Amy  proficiency  training  policy. 
Generally,  these  Implications  suggest  no  serious  retraining  problems  would  j 

result  from  non-flying  periods  up  to  three  yearn  in  length.  These  Impll-  | 

cations  are  then  discussed  as  they  relate  to  accident  rates,  costs,  re-  | 

training  time,  habit  interference,  and  effects  of  non-flying  on  pilot  career  I 

plans  (l.e.,  retention  in  the  service).  With  reference  to  this  latter  [ 

point,  resulta  of  the  limited  opinion  survey  suggest  no  signli leant  problem. 

However,  the  survey  was  much  too  limited  In  number  of  respondents  to  draw 
any  conclusion  on  this  point. 

2.  Comment 

This  survey  was  performed  in  response  to  an  Army  request  for  information 
on  a fairly  tight  time  schedule.  It  was  somewhat  limited  In  scope  for  this 
reason,  and,  as  a quick  response  to  a military  requesting  agency,  the  report 
has  not  been  available  as  a formal  publication.  Nevertheless,  the  summary 
is  reasonably  comprehensive,  and  the  author's  interpretations  are  sound. 
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VII.  ITEMS  REVIEWED,  BUT  NOT  PERTINENT 


A number  of  items  turned  up  In  the  lltereture  search  that,  upon 
review,  were  Judged  to  be  of  no  real  pertinence  to  the  topic  of  long- 
term retention  of  flying  skills.  While  many  such  items  could  t>e  summar- 
ily dismissed  as  of  no  concern  from  their  titles,  abstracts,  or  other 
sources,  a number  could  not.  Therefore,  a number  of  documents  were 
secured  and  reviewed  in  some  detail  before  being  rejected  from  inclusion. 
This  section  lists  a number  of  these  "reviewed,  not  pertinent"  items. 

The  purpose  of  this  listing  is  twu-fold:  (1)  to  let  the  reader  know  that 

these  items  were  considered,  and  (2)  possibly  to  save  a reader  interested 
in  long-term  flying  skill  retention  the  trouble  of  examining  these  items 
in  the  future.  As  can  be  seen,  many  of  these  Items  have  seemingly  perti- 
nent titles,  but  were  Judged  to  be  irrelevant  or  to  add  no  worthwhile  in- 
formation concerning  our  topic  of  interest.  In  a broader  sense,  of  course, 
one  can  consider  even  most  of  those  items  as  of  some  pertinence,  because 
they  do  deal  with  learning  or  aviation  topics. 
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